Differences
This shows you the differences between two versions of the page.
Both sides previous revision Previous revision Next revision | Previous revision | ||
rdms:best [2024/03/27 13:45] jelte [Detecting Locked Files] Added something about resolving. |
rdms:best [2024/03/28 15:22] (current) burcu [Best Practices] |
||
---|---|---|---|
Line 5: | Line 5: | ||
The section will be gradually updated with new usage examples and tips. | The section will be gradually updated with new usage examples and tips. | ||
- | If you believe that important information should be added to this section, please | + | If you believe that important information should be added to this section, please contact [[rdms-support@rug.nl|RDMS support]] with your request! |
- | ===== Data Naming ===== | + | ===== Naming |
For the optimal usage of the RDMS, it is highly recommended to follow these best practices for naming your files/ | For the optimal usage of the RDMS, it is highly recommended to follow these best practices for naming your files/ | ||
Line 60: | Line 60: | ||
===== Bundling of Data Sets ===== | ===== Bundling of Data Sets ===== | ||
- | To improve the performance of the RDMS, it is recommended to store data sets which contain a lot of single, smaller | + | To improve the performance of the RDMS, it is recommended to store data sets numerous small files in a structured format like '' |
- | These has the advantage that it improves | + | |
- | The best practice | + | Best practices |
- Fist, collect all data locally. | - Fist, collect all data locally. | ||
- | - Before | + | - Before |
- Upload the bundled format to the RDMS. | - Upload the bundled format to the RDMS. | ||
- | - (Add metadata if desired.) | + | - (Optional) |
- | - (Unbundle | + | - (Optional) |
- | The last two steps, adding additional metadata as well as unbundling again on the RDMS side, are not mandatory. | + | For extraction |
- | For extraction on the RDMS side, CLI users can use the '' | + | For RDMS web interface |
- | Users of the RDMS web interface, can use the " | + | ===== Locked Files (HIERARCHY_ERROR) ===== |
- | ===== Detecting Locked Files (HIERARCHY_ERROR) ===== | + | In rare cases, data may arrive in an incomplete form in the RDMS. This usually happens if a data transfer abruptly interrupted, |
- | In rare cases, it can happen | + | Restarting the data transfer may solve this issue. However, it is possible |
- | Restarting the data transfer can solve this issue, but it can also happen that the already transferred data is kept in a locked state which results in problems when the transfer is restarted as those files cannot be overwritten directly. | + | If you experience these issues, it is recommended to contact [[rdms-support@rug.nl|RDMS-Support]]. |
- | If you experience these issues, it is normally recommended to contact | + | Users of the command-line tool [[rdms: |
- | Users of the command-line tool [[rdms: | + | In general, these issues manifest in '' |
- | + | ||
- | In general, these issues manifest in '' | + | |
To check all files at a RDMS location ''/ | To check all files at a RDMS location ''/ | ||
Line 101: | Line 98: | ||
</ | </ | ||
- | **What to do with locked files** | + | ==== Removal of Locked Files ==== |
- | While the locked files cannot be directly removed, they can still be moved first to another location in the your home/team location, for example a separate folder for locked files. Afterwards, the data transfer can be restarted. | + | |
+ | While the locked files cannot be directly removed, they can still be moved first to another location in your home/team location, for example | ||
- | So the best practice for handling | + | Best practices to handle |
- | - Create a new folder in your home or team drive that will contain all locked files. | + | - Create a new folder in your home or team drive to contain all locked files. |
- | - Move the locked files that were found via `iquest` | + | - Use the ' |
- | - Now, restart | + | - Restart |
- If you accumulated multiple locked files in your folder which you cannot delete, please contact [[rdms-support@rug.nl|RDMS-Support]] and we will help you remove these. | - If you accumulated multiple locked files in your folder which you cannot delete, please contact [[rdms-support@rug.nl|RDMS-Support]] and we will help you remove these. | ||
- | **Note:** It is recommended not to message | + | **Note:** It is recommended not to contact |