This is an old revision of the document!
Uploading and file size
Under 32 Mb
For files under 32 Mb you can use the graphical web interface of the RDMS to upload your data.
Over 32 Mb until 4 Gb
For larger files you must use a client other than the graphical web interface. Multiple options exist including WebDAV and command-line tools. With these, any size file can be transferred, but it is recommended to transfer the largest files at the command line.
WebDAV
WebDav is a file transfer protocol. For Windows, MacOS and Linux there are multiple WebDav clients you can use.
- For MacOS: Finder
- For Linux: WebDAV via GNOME
Over 4 Gb
For largest files, the iRODS native iCommands are the best option. Here are three different ways to use them:
- via SCP/SFTP to Peregrine. The peregrine network is faster than the regular network, so chances for errors are smaller. Of course you do need an account for Peregrine, but then you can upload to peregrine:/scratch/<pnummer> and later on upload it to the RDMS.
- Linux: via the command line and iCommands.
- Under Windows: WSL2. This is a virtualization of the Linux kernel in the Windows Operating System. https://docs.microsoft.com/en-us/windows/wsl/wsl2-install. After installing WSL2 you need to install iCommands.
A large set of small files
With iCommands you can unpack a zip or tar file with these small files. Uploading the files while in a zip or tar archive will tremendously reduce the operation time.