糖心视频


New Globus Online service to use the grid for high-performance file transfer

A new tool that will provide secure file–transfer service to manage large–scale data was introduced Nov. 18 at an international conference in New Orleans. , which will use a cloud–based system rather than complex, custom information technology infrastructure, was displayed at , an international conference for high–performance computing, networking, storage and analysis.

The team that created Globus is housed at the Computation Institute, a joint initiative between the University of Chicago and Argonne National Laboratory, and includes collaborators from the University of Southern California鈥檚 Information Sciences Institute and Lawrence Berkeley National Laboratory.

Globus Online automates the mundane but error鈥損rone and time鈥揷onsuming activity of moving files across wide area networks. Users can make their file鈥搕ransfer request, and Globus Online will manage the entire operation, monitor performance, retry failed transfers and recover from faults automatically whenever possible so that users focus on their research.

The National Energy Research Scientific Computing Center was an early adopter of Globus Online and is now recommending the service to its users as a secure, fault鈥搕olerant file鈥搕ransfer solution.

鈥淲e are excited to offer a simplified, yet reliable data movement method to our users,鈥 said David Skinner, group leader at NERSC. 鈥淎s the collection of Globus Online endpoints grows, our users will be using the highest鈥損erforming wide area network鈥搕uned systems with simplicity.鈥

Globus Online works across and between any servers that have the GridFTP installed, including systems at Department of Energy facilities such as NERSC, Oak Ridge, and Argonne; large鈥搒cale Globus based cyberinfrastructure in the United States and abroad, such as TeraGrid, Open Science Grid, European Grid Infrastructure, and Australian Research Collaboration Service; as well as many campus grids. Users can rapidly access this international pool of resources using Web, command line and Representation State Transfer interfaces, without installing any software.

鈥淲e are in an era of explosive data growth, where requirements for reliable data movement are more demanding, and distributed environments are more complex. Globus Online goes a long way toward helping users navigate this 鈥榩erfect data storm鈥 without expensive, custom鈥揵uilt solutions,鈥 said Ian Foster, director of the Computation Institute. 鈥淏uilding on our 15鈥搚ear heritage with the Globus Toolkit, we continue to challenge ourselves to deliver innovative solutions for large鈥搒cale distributed computing.鈥

Commonly used file transfer mechanisms, such as the secure copy command found on most systems, require complex configuration for optimal performance and frequent attention from the user to deal with transient faults 鈥 perhaps the most frustrating aspect of distributed data management. Globus Online transparently handles faults by re鈥搕rying failed transfers and provides detailed logs for users and service operators to understand the reasons behind any failed transfers.

Managing security across multiple domains has traditionally been a challenge for grid users. Globus Online manages multiple security credentials automatically on behalf of users. When a certificate expires, for example, Globus Online suspends the file transfer, notifies the user and automatically resumes when a valid credential is received.

In its current release, Globus Online allows users to move files between systems with GridFTP installed. Upcoming releases will add support for HTTP, opening up the service to any file system with access to a Web server, as well as InCommon, allowing members of many academic and research institutions to access the service using their existing campus logins.

Provided by University of Chicago

Citation: New Globus Online service to use the grid for high-performance file transfer (2010, November 22) retrieved 28 July 2025 from /news/2010-11-globus-online-grid-high-performance.html
This document is subject to copyright. Apart from any fair dealing for the purpose of private study or research, no part may be reproduced without the written permission. The content is provided for information purposes only.

Explore further

New technology enables high-speed data transfer

0 shares

Feedback to editors