Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision		 Previous revision
rdms:workflows:archiving [2025/08/21 10:36] – [Best Practices] burcurdms:workflows:archiving [2025/08/22 07:42] (current) – [Step 2: Check Data and copy to Project Archive] burcu
Line 24: Line 24:
 ===== Steps of the Archiving Workflow ===== ===== Steps of the Archiving Workflow =====
  
-This section explains the Archiving workflow starting from an existing RDMS example project and walks you through the requirements to start the workflow, the different steps, and the roles active at each step. It will also elaborate more on the content of the created //data package//.+This section explains the Archiving workflow starting from an existing RDMS example project and walks you through the requirements to start the workflow, the different steps, and the roles active at each step. It will also elaborate more on the content of the created data package.
  
 ==== Prerequisites ==== ==== Prerequisites ====
Line 51: Line 51:
  
 **Notes:**  **Notes:** 
-  * To assign a user as project admin, select the 'own' permission. Please note that the user needs elevated privileges (having 'own' is not enough) to be able to act as a project admin. In cases where this is needed, please contact [[rdms-support@rug.nl|rdms-supprt@rug.nl]].+  * To assign a user as Project Admin, select the **own** permission. Please note that the user needs elevated privileges; having **own** permission alone is not sufficient. If this is needed, please contact [[rdms-support@rug.nl|rdms-supprt@rug.nl]].
   * To assign a user role, the user needs to have at least 'read' permission in the project.    * To assign a user role, the user needs to have at least 'read' permission in the project. 
-  * The section about best practices gives useful information on how these roles could be assigned in a smart way.+  * The section about [[rdms:workflows:archiving#best_practices|best practices]] provides useful guidance on how these roles could be assigned effectively.
  
  
Line 65: Line 65:
 ---- ----
  
-To initialize the workflow via the data management tab, open the respective project in the tab, then open the menu in the top-right corner (cogwheel symbol) and select //Archive data//, as shown below.  +To initialize the workflow via the Data Management tab, open the respective project in the tab, then open the menu in the top-right corner (cogwheel symbol) and select "Archive data", as shown below.  
  
 {{ :rdms:workflows:rdms_workflow_init_2.png?direct&600 |}} {{ :rdms:workflows:rdms_workflow_init_2.png?direct&600 |}}
Line 77: Line 77:
 {{ :rdms:workflows:rdms_workflow_init_4.png?direct&600 |}} {{ :rdms:workflows:rdms_workflow_init_4.png?direct&600 |}}
  
-After clicking //Archive data//, you have completed this part of the workflow. Look to "Step 2" on this page for the next part.+After clicking "Archive data", you have completed this part of the workflow. Look to "Step 2" on this page for the next part.
 ---- ----
  
Line 110: Line 110:
 {{ :rdms:workflows:rdms_workflow_dataprep_1.png?direct&600 |}} {{ :rdms:workflows:rdms_workflow_dataprep_1.png?direct&600 |}}
  
-If you select the //Append data// option, you will be able to add data to the archive. Selecting this option will also open a new window, where you will be guided through adding data. Use this option if the project admin did not add all the data necessary to the archive at the previous step.\\+If you select the "Append data" option, you will be able to add data to the archive. Selecting this option will also open a new window, where you will be guided through adding data. Use this option if the project admin did not add all the data necessary to the archive at the previous step.\\
  
-After all data was added, you can click on the //Prepare data// option to get a view of the currently selected data in a new window. In this window, you can verify that the data that needs to be archived is correct and complete, but you can also remove data again. Additionally, you can select an option that will allow you to add [[rdms:metadata:|RDMS metadata]] to the archive. What we mean here is that you will be adding metadata that was added to files and folders included in the archive, not that you are adding metadata **about** the archive. This will happen in a later step. +After all data was added, you can click on the "Prepare data" option to get a view of the currently selected data in a new window. In this window, you can verify that the data that needs to be archived is correct and complete, but you can also remove data again. Additionally, you can select an option that will allow you to add [[rdms:metadata:|RDMS metadata]] to the archive. What we mean here is that you will be adding metadata that was added to files and folders included in the archive, not that you are adding metadata **about** the archive. This will happen in a later step. 
  
 {{ :rdms:workflows:rdms_workflow_dataprep_2.png?direct&600 |}} {{ :rdms:workflows:rdms_workflow_dataprep_2.png?direct&600 |}}
Line 118: Line 118:
 \\ \\
 \\ \\
-Finally, once you are ready, click on the //Copy data to archive// option to move the archive draft to the next step. A window will open, where you can verify if the data was sent to **Archive** once again. If you decide to approve the data in this window, then the archiving workflow will start copying your data from the project space to the project's data archive.+Finally, once you are ready, click on the "Copy data to archive" option to move the archive draft to the next step. A window will open, where you can verify if the data was sent to Archive once again. If you decide to approve the data in this window, then the archiving workflow will start copying your data from the project space to the project's data archive.
  
 {{ :rdms:workflows:rdms_workflow_dataprep_3.png?direct&600 |}} {{ :rdms:workflows:rdms_workflow_dataprep_3.png?direct&600 |}}
Line 133: Line 133:
 **Prerequisites**: Step 2 has finished. **Prerequisites**: Step 2 has finished.
  
-In this step, the previously unbundled data that was moved to the project's archive space in the RDMS is bundled into a **data package**. This data package is a tar file containing the selected data, as well as RDMS file and folder metadata if the option to export it was selected in the previous step.+In this step, the previously unbundled data that was moved to the project's archive space in the RDMS is bundled into a data package. This data package is a tar file containing the selected data, as well as RDMS file and folder metadata if the option to export it was selected in the previous step.
  
 ---- ----
-This step should be a short one if the data is in order. It is mostly implemented to make sure that if there is more than one data manager, they have the ability to check what the other data managers did. If you did implement our suggestion of having one data manager with final say, then this step is where they get to do a last check. In this step, you have the option to //Preview data//, to //Create data package//, and to //Prepare data// (see screenshot below).+This step should be a short one if the data is in order. It is mostly implemented to make sure that if there is more than one data manager, they can check what the other data managers did. If you did implement our suggestion of having one data manager with final say, then this step is where they get to do a last check. In this step, you have the option to "Preview data", to "Create data package", and to "Prepare data" (see screenshot below).
  
 {{ :rdms:workflows:rdms_workflow_dp_2.png?direct&600 |}} {{ :rdms:workflows:rdms_workflow_dp_2.png?direct&600 |}}
  
-If you select //Preview data//, a window will show you the data contained in the archive draft. At this stage, the data package has not been created yet, and data can still be freely added to the archive. If you wish to add more data, select //Prepare data// to move the card back a step. Add the necessary data to the archive draft, then move the card back to the //Data package// column.+If you select "Preview data", a window will show you the data contained in the archive draft. At this stage, the data package has not been created yet, and data can still be freely added to the archive. If you wish to add more data, select "Prepare data" to move the card back a step. Add the necessary data to the archive draft, then move the card back to the "Data package" column.
  
 {{ :rdms:workflows:rdms_workflow_dp_1.png?direct&600 |}} {{ :rdms:workflows:rdms_workflow_dp_1.png?direct&600 |}}
  
-If you select the //Create data package// option in the menu, the RDMS system will automatically bundle the previously unbundled data into a tar archive. Afterwards, the next step (adding metadata to the data package) can follow.+If you select the "Create data package" option in the menu, the RDMS system will automatically bundle the previously unbundled data into a tar archive. Afterwards, the next step (adding metadata to the data package) can follow.
  
 {{ :rdms:workflows:rdms_workflow_dp_4.png?direct&600 |}} {{ :rdms:workflows:rdms_workflow_dp_4.png?direct&600 |}}
  
-**Notes**: As mentioned above, you cannot directly add more data via the workflows page in this step. If you or another data manager sees that wrong data was selected or that data is missing, then you have to select the //Prepare data// option, which will move the workflow back to the previous step. There, you can adjust the content of the archive draft before moving it back to the current step.+**Note**: As mentioned above, you cannot directly add more data via the workflows page in this step. If you or another data manager sees that wrong data was selected or that data is missing, then you have to select the "Prepare data" option, which will move the workflow back to the previous step. There, you can adjust the content of the archive draft before moving it back to the current step.
 </hidden> </hidden>
  
Line 162: Line 162:
 While the RDMS in general allows the user to add metadata with or without a metadata template, the archiving workflow only allows adding metadata via templates. This is done to help standardize the metadata for archived projects and, therefore, make them better findable. Templates can be created by users and also shared with others. If there is no suitable metadata template present, you will therefore have to create one, as described in the [[rdms:metadata:metadatatemplates|Metadata Template section of the wiki]]. Nevertheless, please remember that you are adding metadata about the archive during this step, not about the single files and folders within it. As such, you might not need too much complexity when it comes to the metadata template you want to use.\\ While the RDMS in general allows the user to add metadata with or without a metadata template, the archiving workflow only allows adding metadata via templates. This is done to help standardize the metadata for archived projects and, therefore, make them better findable. Templates can be created by users and also shared with others. If there is no suitable metadata template present, you will therefore have to create one, as described in the [[rdms:metadata:metadatatemplates|Metadata Template section of the wiki]]. Nevertheless, please remember that you are adding metadata about the archive during this step, not about the single files and folders within it. As such, you might not need too much complexity when it comes to the metadata template you want to use.\\
 \\ \\
-As in previous steps, the three-dot menu holds all the actions you can perform at this stage. They are, in order, //Add DOI//, //Add metadata template//, //Approve metadata//, and //Data package//. If you are a data manager, you can move the archive draft back to the previous step. We do not expect you to have to do it, but last-minute changes to a data set could still happen. This is why you still have the option to edit the data.+As in previous steps, the three-dot menu holds all the actions you can perform at this stage. They are, in order, "Add DOI", "Add metadata template", "Approve metadata", and "Data package". If you are a data manager, you can move the archive draft back to the previous step. We do not expect you to have to do it, but last-minute changes to a data set could still happen. This is why you still have the option to edit the data.
  
 {{ :rdms:workflows:rdms_workflow_meta_3.png?direct&600 |}} {{ :rdms:workflows:rdms_workflow_meta_3.png?direct&600 |}}
  
-If you select //Add metadata template//, you will see a new window open. At the very top of the window, you can choose which template you want to fill in. Then you can select or type in the different metadata entries the template requires you to add. This step allows for both metadata as well as data managers to add metadata.+If you select "Add metadata template", you will see a new window open. At the very top of the window, you can choose which template you want to fill in. Then you can select or type in the different metadata entries the template requires you to add. This step allows for both metadata as well as data managers to add metadata.
  
 {{ :rdms:workflows:rdms_workflow_meta_2.png?direct&600 |}} {{ :rdms:workflows:rdms_workflow_meta_2.png?direct&600 |}}
  
-If you have already generated a DOI for the dataset, then you can use the //Add DOI// menu button to insert the existing DOI into the metadata of the archive. You can also add a DOI linked to a related publication in this stage of the archiving workflow. The RDMS will check the DOI and will verify its validity. Please note that the correct format of the DOI to be specified is ''prefix/suffix'', **not** URL. +If you have already generated a DOI for the dataset, then you can use the "Add DOI" menu button to insert the existing DOI into the metadata of the archive. You can also add a DOI linked to a related publication in this stage of the archiving workflow. The RDMS will check the DOI and will verify its validity. Please note that the correct format of the DOI to be specified is ''prefix/suffix'', **not** URL. 
  
 {{ :rdms:workflows:rdms_workflow_meta_1.png?direct&600 |}} {{ :rdms:workflows:rdms_workflow_meta_1.png?direct&600 |}}
  
-The last option in the menu we have not yet addressed is //Approve metadata//. This action is **available only to the metadata manager**. If you or other metadata managers have checked that the metadata has been filled in properly, then you can press the button //Approve metadata// to move the archive draft to the final stage of the archiving workflow. Note that a DOI link was automatically added as a metadata entry if a DOI was specified. +The last option in the menu we have not yet addressed is "Approve metadata". This action is **available only to the metadata manager**. If you or other metadata managers have checked that the metadata has been filled in properly, then you can press the button "Approve metadata" to move the archive draft to the final stage of the archiving workflow. Note that a DOI link was automatically added as a metadata entry if a DOI was specified. 
  
 {{ :rdms:workflows:rdms_workflow_meta_4.png?direct&600 |}} {{ :rdms:workflows:rdms_workflow_meta_4.png?direct&600 |}}
Line 190: Line 190:
 ---- ----
  
-At this stage of the archiving workflow, you have two options left as the data manager. You can either push the archive draft back to the add/confirm metadata stage by pressing //Metadata//, because some things are still missing, or press the //Archive// button to create the final archive and finish the workflow.+At this stage of the archiving workflow, you have two options left as the data manager. You can either push the archive draft back to the add/confirm metadata stage by pressing "Metadata", because some things are still missing, or press the "Archive" button to create the final archive and finish the workflow.
  
 {{ :rdms:workflows:rdms_archiving_appove_1.png?direct&800 |}} {{ :rdms:workflows:rdms_archiving_appove_1.png?direct&800 |}}
  
-Pressing //Archive// will open a new window one last time, presenting all the info about the archived data package, its final destination, as well as all metadata that will be added to the archive. If everything looks good, you can use the //Archive// button to finalize the workflow. +Pressing "Archive" will open a new window one last time, presenting all the info about the archived data package, its final destination, as well as all metadata that will be added to the archive. If everything looks good, you can use the "Archive" button to finalize the workflow. 
  
 {{ :rdms:workflows:rdms_archiving_appove_2.png?direct&800 |}} {{ :rdms:workflows:rdms_archiving_appove_2.png?direct&800 |}}
Line 205: Line 205:
 ===== The Data Package and its Content =====  ===== The Data Package and its Content ===== 
  
-At the end of the archiving workflow, you will have created a **data package**. In the RDMS, we use this term to identify a data set with a specific structure that resulted from the archiving workflow. In this section, we will have a more detailed look at the data package and explain its internal structure. +At the end of the archiving workflow, you will have created a data package. In the RDMS, we use this term to identify a data set with a specific structure that resulted from the archiving workflow. In this section, we will have a more detailed look at the data package and explain its internal structure. 
  
 In general, the following applies: In general, the following applies:
Line 273: Line 273:
 ===== Best Practices ===== ===== Best Practices =====
  
-This section provides recommendations on how to assign roles within a project in order to distribute the tasks of the Archiving workflow efficiently among project participants. It also highlights best practices specific to the project archiving process.+This section provides recommendations on how to assign roles within a project to distribute the tasks of the Archiving workflow efficiently among project participants. It also highlights best practices specific to the project archiving process.
  
 In general, roles can be assigned as follows: In general, roles can be assigned as follows:
Line 287: Line 287:
  
   * **Metadata Manager**: The Metadata Manager is responsible for verifying that the metadata associated with the archive is accurate and complete.   * **Metadata Manager**: The Metadata Manager is responsible for verifying that the metadata associated with the archive is accurate and complete.
- +        * Ideally, this role should be assigned to someone with knowledge of the data who was not directly involved in earlier steps of the workflow. 
-         * Ideally, this role should be assigned to someone with knowledge of the data who was not directly involved in earlier steps of the workflow. +        * If such a person is not available, a Data Manager may also serve as Metadata Manager. 
-         * If such a person is not available, a Data Manager may also serve as Metadata Manager. +        * If there were multiple Data Managers in the earlier steps, we suggest assigning the Metadata Manager role to one who did not have final authority over the dataset. 
-         * If there were multiple Data Managers in the earlier steps, we suggest assigning the Metadata Manager role to one who did not have final authority over the dataset. +        * If your project or research group has dedicated data management staff, they are well-suited for this role.
-         * If your project or research group has dedicated data management staff, they are well-suited for this role.+
  
 As noted above, multiple roles can be assigned to the same user. If a user is both a data and metadata manager, then the whole workflow, except for the initialization, can be done by that single user. This is also a valid possibility, but we suggest you make use of the "checks and balances" that the archiving workflow introduces by assigning roles to different users, where possible.  As noted above, multiple roles can be assigned to the same user. If a user is both a data and metadata manager, then the whole workflow, except for the initialization, can be done by that single user. This is also a valid possibility, but we suggest you make use of the "checks and balances" that the archiving workflow introduces by assigning roles to different users, where possible.