Reccomendation: In order to have a smooth and efficient start of work with the Lichtenberg-HPC, we advise all new users to attend the “Introduction to the Lichtenberg High Performance Computer”.
Login nodes are used to access the cluster from outside. You can find a current list of accessible login nodes here.
SSH-Fingerprints of all login-nodes – new since 16th November 2017:
Valid Ciphers, MACs and KEx algorithms:
With respect to installed software, the login nodes are identical, so it does not matter which one you use. In terms of hardware however, there are two types (details here).
Users log in with
ssh on one of the login nodes and put their jobs into the queue. For that, you need to specify your required resources (e.g. amount of main memory, number of nodes (and tasks), maximum runtime) per job.
The login nodes are not for “productive” calculations!
Used by all users of the HPC, the login nodes are intended to be used only for
- job preparation and submission
scp'ing data in and out of the cluster
- short test runs of your program
- debugging your software
- job status checking
Due to the login nodes facing the public (and sometimes evil) internet, we have to install (security) updates from time to time. This will happen on short notice (30 minutes). Don't expect all login nodes to be available 24h/7d.
Batch system Slurm
The arbitration, dispatching and processing of all user jobs on the cluster is organized with the Slurm batch system. Slurm calculates when and where a given job will be started, considering all jobs' resource requirements, workload of the system, waiting times of the job and the priority of the associated project.
When eligible to be run, the user jobs are dispatched to one (or more) compute nodes and started there by Slurm.
The batch system expects a batch script for each job (array), which contains
- the resource requirements of the job in form of
#SBATCH …pragmas and
- the actual commands and programs you want to be run in your job.
The batch script is a plain text file (with UNIX line feeds!) and can either be created on your local PC and then be transferred to the login node. In Windows, use “Notepad++” and switch to UNIX (LF) in “Edit” – “Line feed format” before saving the script.
Or you can create it with UNIX editors on the login node itself and avoid the fuss with improper line feeds.
- Commands of batch systems, and examples of batch jobs
- Queues and computing resources
- File systems
- FAQ about the batch scheduler and job scripts