🌐 Globus — Data Transfer Guide
Globus is a secure, high-performance data transfer tool for moving large datasets across HPC systems and institutions. It is the recommended method for reliable large-scale transfers.
Why Use Globus?
- Handles large dataset transfers (GB–TB scale)
- Automatic recovery from network or transfer failures
- Optimized for HPC storage systems and institutional collaboration
1. Login Instructions
- Go to
app.globus.org - Select your institution:
- WCM Users: Weill Cornell Medicine
- Cornell Users: Cornell University
- Log in using your CWID credentials
2. Transfer Workflow & Endpoints
- Open Globus File Manager
- Search and select your destination endpoint. Note that access has to be granted by Scientific Computing HPC Core to use SCU managed endpoints.
| Endpoint | Cluster | Use Case |
|---|---|---|
wcmc#scu-brb | BRB | External institutional transfers, e.g NYGenome |
wcmc#scu-dtn-internal | BRB | Internal institutional transfers, e.g NYU and within WCM Campus |
cac#cayuga | Cayuga | Transfer Endpoint for Cayuga Cluster |
- Set directory path:
/athena/<labname>/scratch/<cwid>/Pro Tip: The Sync option (located under "Transfer & Sync Options" in the File Manager) can be used to only move new or changed files.
3. Verifying Transfers
Do not assume a transfer is finished just by closing the window:
- Activity Tab: Click the "Activity" icon in the left-hand menu to monitor status and view history.
- Email Alerts: Globus sends an automated email once the task is complete or if it has failed.
4. Post-Transfer Check
Files may land with restrictive permissions. To ensure your lab can access the data, run this on the HPC terminal:
chmod -R 750 /athena/<labname>/...Globus Personal Connect
Enables transfers between your local machine and HPC systems.
⚠️ Setup Note: Do not use VPN during the initial setup. Corporate VPNs block or misroute local network discovery and loopback interfaces required during initial client configuration. VPN may be re-enabled after configuration is complete.
Personal Connect Setup Steps:
- Install: Run the downloaded installer on your local machine and complete the setup wizard.
- Name the Collection: Provide a unique name for your personal collection endpoint.
- Choose Accessible Folders: Select and configure which local directories on your computer are accessible for transfers.
- Keep Awake & Running: Ensure your computer does not go to sleep and keep the Globus Connect Personal application open and running for the duration of the transfer.
SCU High-Performance Computing Technical Documentation — 2026.