Getting Access
Access to the cluster is subject to formal approval by selected members of the participating research groups. See the HPC Service Webpage for more information on access options.
Introductory Linux Training and Resources
If you're not familiar with basic Linux commands and usage, or if you need a refresher on these topics, please refer to the following resources from our workshop series:
- Intro to Linux - Slides A general intro to the Linux command line. Not about Insomnia.
- Intro to Shell Scripting - Slides A general intro to the Linux command line. Not about Insomnia.
- Intro to Shell Scripting - Video A general intro to the Linux command line. Not about Insomnia.
- Intro to High Performance Computing - Slides Computing concepts specifically for clusters, such as Insomnia.
For a list of upcoming research computing workshops and events, please see:
https://rcfoundations.research.columbia.edu/
Logging In
You will need to use SSH (Secure Shell) in order to access the cluster. Windows users can use PuTTY or Cygwin. MacOS users can use the built-in Terminal application.
Users log in to the cluster's submit node, located at Insomnia.rcs.columbia.edu or use the shorter form burg.rcs.columbia.edu. If logging in from a command line, type:
$ ssh <UNI>@insomnia.rcs.columbia.edu OR $ ssh <UNI>@som.rcs.columbia.edu
where <UNI> is your Columbia UNI. Please make sure not to include the angle brackets ('<' and' >') in your command; they only represent UNI as a variable entity.
Once prompted, you need to provide your usual Columbia password.
Submit Account
You must specify your account whenever you submit a job to the cluster. You can use the following table to identify the account name to use.
Account | Full Name |
|---|---|
| 5sigma | Biostatistics |
| berkelbach | Chemistry |
| cal | Columbia Astrophysics Lab |
| cboyce | Chemical Engineering |
| cklab | IEOR |
| db | Computer Science |
| e3b | Ecology, Evolution and Environmental Biology |
| esma | SIPA-CGEP |
| hill | Physics (Columbia Astrophysics Laboratory) |
| ieortang | Industrial Engineering and Operations Research (IEOR) |
| iicd | Irving Institute for Cancer Dynamics |
| morpheus | Bianca Dumitrascu Lab |
| msph | MSPH IT |
| ntar_lab | Biomedical Engineering (Morrison) |
| pas_lab | Biological Sciences |
| ueil | Biomedical Engineering (Konofagou) |
| qmech | Quantum Mechanics/Applied Physics and Applied Math: Marianetti |
| xulab | Earth and Environmental Engineering |
Your First Cluster Job
Submit Script
This script will print "Hello World", sleep for 10 seconds, and then print the time and date. The output will be written to a file in your current directory.
In order for this example to work you need to replace ACCOUNT with your group account name. If you don't know your account name the table in the previous section might help.
#!/bin/sh # # Simple "Hello World" submit script for Slurm. # # Replace ACCOUNT with your account name before submitting. # #SBATCH --account=ACCOUNT # Replace ACCOUNT with your group account name #SBATCH --job-name=HelloWorld # The job name #SBATCH -N 1 # The number of nodes to request #SBATCH -c 1 # The number of cpu cores to use (up to 32 cores per server) #SBATCH --time=0-0:30 # The time the job will take to run in D-HH:MM #SBATCH --mem-per-cpu=5G # The memory the job will use per cpu core echo "Hello World" sleep 10 date # End of script
Job Submission
If this script is saved as helloworld.sh you can submit it to the cluster with:
$ sbatch helloworld.sh
This job will create one output file name slurm-####.out, where the #'s will be replaced by the job ID assigned by Slurm. If all goes well the file will contain the words "Hello World" and the current date and time.
See the Slurm Quick Start Guide for a more in-depth introduction on using the Slurm scheduler.