Differences
This shows you the differences between two versions of the page.
Both sides previous revision Previous revision Next revision | Previous revision | ||
rdms:webapp:processes [2025/03/18 10:10] – [Delayed Rules] some text jelte | rdms:webapp:processes [2025/08/20 07:41] (current) – fixed punctuation + small text change giulio | ||
---|---|---|---|
Line 1: | Line 1: | ||
- | ====== Processes/Jobs ====== | + | ====== Processes |
{{indexmenu_n> | {{indexmenu_n> | ||
- | The RDMS web interface allows you to observe | + | The RDMS web interface allows you to observe |
- | {{ : | + | {{ : |
===== Processes/ | ===== Processes/ | ||
Line 10: | Line 10: | ||
Currently, the following operations are visible as processes: | Currently, the following operations are visible as processes: | ||
- | - Uploading of data via the web interface | + | - Uploading of data via the web interface, |
- | - Bundling operations (compress to tar or decompress) | + | - Bundling operations (compress to tar or decompress), |
- | - Extraction of metadata | + | - Extraction of metadata, |
- | - Different steps of the [[rdms: | + | - Different steps of the [[rdms: |
- | By clicking on a listed process, you can get more details about it. | + | By clicking on a listed process, you can get more details about it, as shown below. |
- | {{ : | + | {{ : |
- | This shows you, for example, the kind of process and the data on which it was executed. Moreover, every process gets a process number as well as a ID. The ID can be used to correlated | + | For example, |
- | **Note:** Not all jobs are executed as Delayed Rules as will described below. For example the upload operation, is not a delayed rule, but it has a Delayed Rule associated with it that is executed in the background (computation of data checksum). | + | **Note:** Not all jobs are executed as delayed rules, |
===== Delayed Rules ===== | ===== Delayed Rules ===== | ||
- | The RDMS is built on top of the data management software [[rdms: | ||
- | We use rules at several places | + | The RDMS is built on top of the data management software [[rdms: |
- | * **Automated checksum calculations of your data**: If you upload files to the RDMS, a automated checksum calculation for your files with be executed | + | We use rules in several places in the RDMS, often as delayed rules. |
- | * **Bundling/ | + | |
+ | * **Automated checksum calculations of your data**: If you upload files to the RDMS, an automated checksum calculation for your files with be executed as a delayed rule. This guarantees that all your files have a checksum registered which gives you and us the capability to check the [[rdms: | ||
+ | * **Bundling/ | ||
+ | |||
+ | You can observe the status of your rules via the second tab in the processes/ | ||
+ | |||
+ | {{ : | ||
+ | |||
+ | The RDMS process ID (highlighted in red) is visible for every delayed rule, which allows you to correlate a job with its respective delayed rule. For example, in the screenshots above, you can see that the process ID is the same for both the delayed rule and for the related job presented in the section above. | ||
+ | |||
+ | The example we show above is a delayed rule linked to the creation of a tar archive (data bundling). You will notice that below the first line ('' | ||
+ | |||
+ | {{ : | ||
+ | |||
+ | The priorities are set such that critical tasks, tasks initiated manually by the user, and tasks that are part of a workflow are allowed to jump the queue and be executed before tasks that are all not essential to the functioning of the system, numerous, common, and automatically scheduled. For example, it is important that the checksum of a file is calculated after the file is uploaded, but this calculation should not stop the archiving workflow from moving to the next step. Even if the file was uploaded way before the workflow started, the calculation of the checksum is given minimal priority, so that it may happen when the system is mostly idle. | ||
+ | |||
+ | You can also check the status of delayed rules via the CLI tool [[rdms: | ||
+ | |||
+ | {{ : |