This is an old revision of the document!
Uploading and file size
Under 32 Mb: For files under 32 Mb you can use the webinterface of the RDMS to upload your data.
Over 32 Mb: For larger files we advise you to use a WebDav client.
WebDav is a file transfer protocol. For Windows, MacOS and Linux there are multiple WebDav clients you can use.
- For MacOS: Finder
- For Linux: WebDAV via GNOME
Larger then 100 Gb
For larger files; (larger then 100 Gb) there are three ways we explored:
- via WebDav to Peregrine. The peregrine network is faster then the regular network, so chances for errors are smaller. Of course you do need an account for Peregrine, but then you can upload to peregrine:/scratch/<pnummer> and later on bring it to the RDMS.
- Linux: via the command line and iCommands.
- Under Windows: WSL2. This is a virtualization of the Linux kernel in the Windows Operating System. https://docs.microsoft.com/en-us/windows/wsl/wsl2-install. After installing WSL2 you need to install iCommands.
A large set of small files: With iCommands you can unpack a zip or tar file with these small files. Uploading the files while in a zip or tar archive will tremendously reduce the operation time.