Research applications often require sophisticated data management capabilities, for example to move large amounts of data between acquisition, storage, analysis and archival. However, doing so efficiently and reliably is often a difficult undertaking, requiring significant expertise to maximize available bandwidth, restart transfers that fail (due to network unreliability), validate that files have been transferred correctly, and securely transfer data between resources with different security configurations. Globus Transfer addresses these challenges by providing an easy to use "fire-and forget" data transfer mechanism that can be integrated by developers into their own applications.
Globus Transfer provides high performance, secure, third-party data movement and synchronization between endpoints, as well as in-place sharing of files directly on existing storage systems. Globus Transfer handles all the difficult aspects of data transfer, allowing application users to easily start and manage transfers between endpoints, while automatically tuning parameters to maximize bandwidth usage, managing security configurations, providing automatic fault recovery, and notifying users of completion and problems. With in-place sharing of data, researchers can share large datasets directly from their existing storage repositories on which the data resides.
Developers can leverage Globus Transfer to provide a high-performance and reliable upload or download mechanism for large (or small) datasets. This allows application users to asynchronously start uploads or downloads and rely on Globus Transfer to ensure the data is moved efficiently and reliably. By integrating Globus Transfer into an application, developers gain access to over 10,000 Globus endpoints.
Explore Globus Transfer
- Globus SDK for Python: Documentation · Source Code
- Experiment with the platform via Jupyter notebooks
- Globus Transfer API Reference
- The Modern Research Data Portal, a new design pattern for providing secure, scalable, and high performance access to research data, is built using Globus platform services