Uploading and file size

This is an old revision of the document!

Under 32 Mb: For files under 32 Mb you can use the webinterface of the RDMS to upload your data.

Over 32 Mb: For larger files we advise you to use a WebDav client.

WebDav is a file transfer protocol. For Windows, MacOS and Linux there are multiple WebDav clients you can use.

For Windows: WinSCP and Cyberduck
For MacOS: Finder
For Linux: WebDAV via GNOME

Larger then 100 Gb

For larger files; (larger then 100 Gb) there are three ways we explored:

via WebDav to Peregrine. The peregrine network is faster then the regular network, so chances for errors are smaller. Of course you do need an account for Peregrine, but then you can upload to peregrine:/scratch/<pnummer> and later on bring it to the RDMS.
Linux: via the command line and iCommands.
Under Windows: WSL2. This is a virtualization of the Linux kernel in the Windows Operating System. https://docs.microsoft.com/en-us/windows/wsl/wsl2-install. After installing WSL2 you can add a Linux profile

A large set of small files: With iCommands you can unpack a zip or tar file with these small files. Uploading the files while in a zip or tar archive will tremendously reduce the operation time.