Table of Contents |
---|
...
If you're not familiar with basic Linux commands and usage, or if you need a refresher on these topics, please refer to the following resources from our workshop series:
- Intro to Linux - Slides A general intro to the Linux command line. Not about Insomnia.and Video Recording
- Intro to Shell Scripting - Slides A general intro to the Linux command line. Not about Insomnia.Intro to Shell Scripting - Video A general intro to the Linux command line. Not about Insomnia.and Video Recording
- Intro to High Performance Computing - Slides Computing concepts specifically for clusters, such as Insomnia. and Video Recording
For a list of recorded trainings and upcoming research computing workshops and events, please see:
https://rcfoundationswww.researchcuit.columbia.edu/rcs/training
Logging In
You will need to use SSH (Secure Shell) in order to access the cluster. Windows users can use PuTTY or Cygwin. MacOS users can use the built-in Terminal application.
...
You must specify your account whenever you submit a job to the cluster. You can use the following table to identify the account name to use.
Account | Full Name |
---|---|
5sigma | Biostatistics |
astro |
Columbia Astrophysics Lab | |
berkelbach | Chemistry |
cboyce | Chemical Engineering |
cklab | IEOR |
db | Computer Science |
e3b | Ecology, Evolution and Environmental Biology |
esma | SIPA-CGEP |
exposomics | MSPH Exposomics |
hill | Physics (Columbia Astrophysics Laboratory) |
houlab | Laboratory of Wenpin Hou |
ieortang | Industrial Engineering and Operations Research (IEOR) |
iicd | Irving Institute for Cancer Dynamics |
intelseedfree | Special group with access to a non-NVIDIA GPU seed node from Intel. email hpc-support@columbia.edu if interested in details. |
mcilvain | Grace McIlvain Lab |
mmsci | Multimessenger Science |
morpheus | Bianca Dumitrascu Lab |
msph | MSPH IT |
neuralctrl | Laboratory for Neural Engineering and Control |
ntar_lab | Biomedical Engineering (Morrison) |
pas_lab | Biological Sciences |
ueil | Biomedical Engineering (Konofagou) |
qmech | Quantum Mechanics/Applied Physics and Applied Math: Marianetti |
sscc | Social Science Computing Committee (ISERP, Econ, and CPRC) |
tekle_smith | Chemistry Dept - Tekle Smith group |
xulab | Earth and Environmental Engineering |
Your First Cluster Job
While best practice on all Columbia HPC group clusters, it is particularly important on Insomnia to move from the initial login node to a compute node before doing most work. Example:
Code Block |
---|
srun --pty -t 0-2:00 -A <ACCOUNT> /bin/bash |
Now you have moved from the login node to one of the compute nodes on the cluster. While simple things like editing a file or making new folders can be done on a login node, they can also be done on a compute node, and as you run more complicated jobs on Insomnia, some things simply will not work unless you are first on a compute node.
An example Submit Script
This script will print "Hello World", sleep for 10 seconds, and then print the time and date. The output will be written to a file in your current directory.
...
See further documentation we have about submitting jobs. For much more in-depth information, there is a Slurm Quick Start Guide on the web.