Data Transfer Tools

Defining Data Transfer Tools

Data Transfer Tools are computer programs which support moving data from Storage Facility to Storage Facility.

Warning

You may be wondering, Why can’t I just use a removable thumb drive or just email data to myself? Using either of these approaches increases the likelihood of losing or misplacing data, breaches data security, and risks introducing malware into our systems. Besides, these tools are much more efficient when moving large amounts of data from place to place. Therefore, these Data Transfer Tools are necessary for data security and are beneficial for user efficiency.

Using alternative methods to transfer data is only possible when there are no other alternatives available and should only be done in consultation with the DCCN support staff.

Supported Tools

At the DCCN, we primarily support four Data Transfer Tools. Each of these four tools have their advantages and disadvantages: DCCN procedures are shaped around these to maximize ease-of-use and efficiency.

There is no need to memorize the specifics of each of these tools - just know that there are multiple tools which have different forms and different function!

Tools at a Glance

Cyberduck and Repocli are both generic tools which support the transfer of data to-and-from all of our Storage Facilities. Cyberduck is easier to use while Repocli offers more scriptability.

In contrast, Stager and Uploader are DCCN specific tools which serve very case-specific functions. Uploader is used to simultaneously move raw data into the Project Folder and the Data Acquisition Collection (this is an RDR collection that saves raw data, but more on this in a second) which automatically saves these data in a standardized, easy-to-use format (this is called BIDS format, more on this in a second as well). Stager moves data between the Project Folder and the RDR, enabling researchers to efficiently restore lost data (or use existing data) or archive data.

	Cyberduck	Repocli	Stager	Uploader
User Interface	Graphical	Comamnd-Line	Web	Web
Transfer Routes	Local <=> RDR Local <=> HPC	Local <=> RDR HPC <=> RDR	Project <=> RDR	Local => Project Local => RDR
Access Restriction			Trigon Network (wired or via eduVPN)	Trigon Network (wired or via eduVPN)
OS Support	Windows MacOSX	Windows MacOSX Linux	Windows MacOSX Linux	Windows MacOSX Linux
Key Feature	Ease-of-use	Scriptable	Efficient	Data Organization

Note

Other tools are also supported by the DCCN such as FileZilla, though this has been phased out to some degree in favor of Cyberduck. There are also tools which are supported by the RU such as Teams and SURFfilesender, though the DCCN does not utilize these so they are not discussed in depth here.