Data Transfer Tools

Defining Data Transfer Tools

Data Transfer Tools are computer programs which support moving data from Storage Facility to Storage Facility.

Warning

You may be wondering, Why can’t I just use a removable thumb drive or just email them to myself? Using either of these approaches increases the likelihood of losing or misplacing data, breaches data security, and risks introducing malware into our systems. Besides, these tools are much more efficient when moving large amounts of data from place to place. Therefore, these Data Transfer Tools are necessary for data security and are beneficial for user efficiency.

Supported Tools

At the DCCN, we support four Data Transfer Tools. Each of these four tools have their advantages and disadvantages: DCCN policies are shaped around these to maximize ease-of-use and efficiency.

There is no need to memorize the specifics of each of these tools - just know that there are multiple tools which have different forms and different function!

Tools at a Glance

Cyberduck and Repocli are both generic tools which support the transfer of data to-and-from all of our Storage Facilities. Cyberduck is easier to use while Repocli offers more scriptability.

In contrast, Stager and Uploader are DCCN specific tools which serve very case-specific functions. Uploader is used to simaltaneously move raw data into the Project Folder and the Data Acquisition Collection (this is an RDR collection that saves raw data, but more on this in a second) which automatically saves these data in a standardized, easy-to-use format (this is called BIDS format, more on this in a second as well). Stager moves data between the Project Folder and the RDR, enabling researchers to efficiently restore lost data (or use existing data) or archive data.

Cyberduck

Repocli

Stager

Uploader

User Interface

Graphical

Comamnd-Line

Web

Web

Transfer Routes

Local <=> RDR
Local <=> HPC
Local <=> RDR
HPC <=> RDR
Project <=> RDR
Local => Project
Local => RDR
Access
Restriction
Trigon Network
or eduVPN
Trigon Network
or eduVPN

OS Support

Windows
MacOSX
Windows
MacOSX
Linux
Windows
MacOSX
Linux
Windows
MacOSX
Linux

Key Feature

Ease-of-use

Scriptable

Efficient

Data Organization

Take Home Messages
  • Data Transfer Tools are necessary to ensure data security and to maximize efficiency

  • Some Data Transfer Tools are better than others in certain situations