Differences
This shows you the differences between two versions of the page.
Both sides previous revision Previous revision Next revision | Previous revision | ||
rdms:best [2024/03/25 13:33] jelte [Detecting Corrupt Files] |
rdms:best [2024/03/28 15:22] (current) burcu [Best Practices] |
||
---|---|---|---|
Line 1: | Line 1: | ||
{{indexmenu_n> | {{indexmenu_n> | ||
====== Best Practices ====== | ====== Best Practices ====== | ||
- | This section | + | This section |
- | The section will be gradually | + | The section will be gradually |
- | If you feel that an important information should be added to this section, | + | If you believe |
- | ===== Data Naming ===== | + | ===== Naming |
For the optimal usage of the RDMS, it is highly recommended to follow these best practices for naming your files/ | For the optimal usage of the RDMS, it is highly recommended to follow these best practices for naming your files/ | ||
Line 16: | Line 16: | ||
* Prefer usage of underscore ('' | * Prefer usage of underscore ('' | ||
- | Example of a folder structure with good naming: | + | Example of a folder structure with correct |
< | < | ||
$ itree project_name | $ itree project_name | ||
Line 37: | Line 37: | ||
</ | </ | ||
- | Example of a folder structure with wrong/ | + | Example of a folder structure with incorrect |
< | < | ||
$ itree " | $ itree " | ||
Line 60: | Line 60: | ||
===== Bundling of Data Sets ===== | ===== Bundling of Data Sets ===== | ||
- | To improve the performance of the RDMS, it is recommended to store data sets which contain a lot of single, smaller | + | To improve the performance of the RDMS, it is recommended to store data sets numerous small files in a structured format like '' |
- | These has the advantage that it improves | + | |
- | The best practice | + | Best practices |
- Fist, collect all data locally. | - Fist, collect all data locally. | ||
- | - Before | + | - Before |
- Upload the bundled format to the RDMS. | - Upload the bundled format to the RDMS. | ||
- | - (Add metadata if desired.) | + | - (Optional) |
- | - (Unbundle | + | - (Optional) |
- | The last two steps, adding additional metadata as well as unbundling again on the RDMS side, are not mandatory. | + | For extraction |
- | For extraction on the RDMS side, CLI users can use the '' | + | For RDMS web interface |
- | Users of the RDMS web interface, can use the " | + | ===== Locked Files (HIERARCHY_ERROR) ===== |
- | ===== Detecting Locked Files ===== | + | In rare cases, data may arrive in an incomplete form in the RDMS. This usually happens if a data transfer abruptly interrupted, |
- | In rare cases, it can happen | + | Restarting the data transfer may solve this issue. However, it is possible |
- | Restarting the data transfer can solve this issue, but it can also happen that the already transferred data is kept in a locked state which results in problems when the transfer is restarted as those files cannot be overwritten directly. | + | If you experience these issues, it is recommended to contact [[rdms-support@rug.nl|RDMS-Support]]. |
- | If you experience these issues, it is normally recommended to contact | + | Users of the command-line tool [[rdms: |
- | Users of the command-line tool [[rdms: | + | In general, these issues manifest in '' |
- | + | ||
- | In general, these issues manifest in '' | + | |
To check all files at a RDMS location ''/ | To check all files at a RDMS location ''/ | ||
Line 101: | Line 98: | ||
</ | </ | ||
- | While the locked files cannot be directly removed, they can still be moved first to another location in the your home/team location, for example a separate folder for locked files. Afterwards, the data transfer can be restarted. | + | ==== Removal of Locked Files ==== |
+ | |||
+ | While the locked files cannot be directly removed, they can still be moved first to another location in your home/team location, for example | ||
+ | |||
+ | Best practices to handle locked files and resolve the '' | ||
+ | |||
+ | - Create a new folder in your home or team drive to contain all locked files. | ||
+ | - Use the ' | ||
+ | - Restart the data transfer. The '' | ||
+ | - If you accumulated multiple locked files in your folder which you cannot delete, please contact [[rdms-support@rug.nl|RDMS-Support]] and we will help you remove these. | ||
+ | |||
+ | **Note:** It is recommended not to contact RDMS support for every locked file, but instead first try to resolve it as described above. However, if numerous locked files are detected, you can directly contact RDMS support. |