The Research Computing team has launched a dedicated, robust, large capacity scientific data storage system called Engram to support research and collaboration for Zuckerman researchers. The system has an initial capacity of roughly two (2) petabytes (2,000 terabytes) and is designed to accommodate growth of tens of thousands of terabytes (TB) over the next years if required.
| Table of Contents |
|---|
About Engram
Engram is a highly versatile scale-out network-attached storage (NAS) platform (EMC Isilon) that can provide fast access to massive amounts of unstructured data. Each of the 24 Engram storage nodes can respond to client requests and all the nodes are connected via a redundant 10 gigabit per second (Gbps) Ethernet fiber optic network. Your data on Engram is backed up to tape, and a copy is stored off-site in a safe and secure location, for disaster recovery cases.
...
We can help you find the best way to use Engram for your particular research - please contact us at rc@zi.columbia.edu.
How to Connect to Engram
Connect to Engram from Mac
Connect to Engram from Windows
Connect to Engram from Linux
Connect to Engram from Synology
Set Up a Proxy in Windows
Tiers of Storage and Rates
Engram has three storage levels.
...
We can help you decide which storage level to start with. Please contact us at rc@zi.columbia.edu.
Data Life Cycle
You control the data stored on Engram. Your data will never be deleted. Only you can delete your data.
Accessing Your Data
Engram is network-attached storage (NAS). It is just like a USB drive you plug into your computer - but instead of plugging the USB drive into your computer with a USB cable, Engram is connected to your server or computer using the network.
...
- From anywhere on Columbia University downtown campus or Manhattanville
- By connecting your computer to the network with a physical network cable
- By using "Columbia U Secure" Wi-Fi
- Note: "Columbia University" Wi-Fi is open and insecure and cannot be used to reach Engram
- From outside the University by using Virtual Private Network (VPN) ( VPN Setup )
- From CUMC: under special circumstances we will work with CUMC IT to open their firewall to allow access to Engram from CUMC locations. Please contact us at rc@zi.columbia.edu
Backing Up Your Data
Data on Engram labshare and locker levels is backed up to tape. We can back up your data on staging storage level if requested.
...
Tape backup is the only data protection technology that protects your data against ransomware. Replication (syncing) solutions do not protect against ransomware.
Restoring Your Data
To request data restore please open a restore request by sending email to rc@zi.columbia.edu and tell us:
- The lab you are from
- The directory from which you would like the files to be restored
- A date range (for example, please restore these files from September 15, 2017)
Requesting Access to Existing Storage
If your lab already has a network drive and you need access to it, please send the following information to rc@zi.columbia.edu:
- Your lab name
- Your full name and UNI
- Name of the network drive you need access to
Requesting New Storage
To request new storage please send the following information to rc@zi.columbia.edu:
...
Please check the storage pricing above (under "Tiers of Storage and Rates").
Storage protocols.
Engram supports three different types of network drives:
...
We can help you decide on Engram size for your lab or project, please contact us at rc@zi.columbia.edu.
Requesting More Storage
To add additional storage capacity to your network drive please send the following information to rc@zi.columbia.edu:
- Your lab name
- Your full name and UNI
- Name of the network drive you would like more storage capacity added to
- How much additional drive capacity you would like to have, in 1 TB increments
Problems Connecting to Engram
If you have problems connecting to Engram, please follow these troubleshooting steps, in order:
...
- Name of your lab
- Your full name and UNI
- Engram drive full path (example: locker-nfs.engram.rc.zi.columbia.edu\YourLab-locker)
What does Engram look like?
Engram is a 24-node storage cluster. All 24 nodes serve data. Data is backed up to tape. A copy of each tape is taken off-site to a secure facility.
Would you like to see what Engram looks like? Email us at rc@zi.columbia.edu and we will give you a tour.
Important Links
Set up Columbia University VPN (CUIT Service)
Change your UNI password (CUIT Service)
...