🌐 Globus — Data Transfer Guide
Globus is a secure, high-performance data transfer tool for moving large datasets across HPC systems and institutions. It is the recommended method for reliable large-scale transfers.
Why Use Globus?
- Handles large dataset transfers (GB–TB scale)
- Automatic recovery from network or transfer failures
- Optimized for HPC storage systems and institutional collaboration
1. Login Instructions
- Go to app.globus.org
- Select your institution:
- WCM Users: Weill Cornell Medicine
- Cornell Users: Cornell University
- Log in using your CWID credentials
2. Transfer Workflow
- Open Globus File Manager
- Search endpoints: weill or cac
- Set directory path:
/athena/<labname>/scratch/<cwid>/
Pro Tip: Use the Sync option to only move new or changed files.
3. Verifying Transfers
Do not assume a transfer is finished just by closing the window:
- Activity Tab: Click the "Activity" icon in the left-hand menu to monitor status and view history.
- Email Alerts: Globus sends an automated email once the task is complete or if it has failed.
4. Post-Transfer Check
Files may land with restrictive permissions. To ensure your lab can access the data, run this on the HPC terminal:
chmod -R 750 /athena/<labname>/...
Globus Personal Connect
Enables transfers between your local machine and HPC systems.
⚠️ Setup Note: Do not use VPN during the initial setup. VPN may be enabled after configuration is complete.
SCU Globus Collections
| Endpoint | Cluster | Use Case |
|---|---|---|
| wcmc#scu-brb | BRB | External institutional transfers, e.g NYGenome |
| wcmc#scu-dtn-internal | BRB | Internal institutional transfers, e.g NYU and within WCM Campus |
| cac#cayuga | Cayuga | Transfer Endpoint for Cayuga Cluster |
SCU High-Performance Computing Technical Documentation — 2026.