| Both sides previous revision
Previous revision
Next revision
|
Previous revision
|
rdms:metadata:metadatawebportal [2023/09/11 14:46]
burcu |
rdms:metadata:metadatawebportal [2023/09/13 10:36] (current)
pascal [Import Metadata] |
| {{ :rdms:webapp:meta_crud_0.png?800 |}} | {{ :rdms:webapp:meta_crud_0.png?800 |}} |
| |
| ==== Create Metadata ==== | ==== Create Metadata in the Web Portal==== |
| | <hidden> |
| When you first upload a file to the RDMS, all the metadata attached to it will be related to system information, such as upload time and file size, as shown above. You can easily attach new metadata to your data by right-clicking the object or collection you wish to add metadata to and then selecting ''Add Metadata''. If you click any of the {{:rdms:webapp:interface_info_button.png?20|}} icons highlighted in the screenshot below, the web portal will open a side menu containing all information about the selected data. There you can easily check what metadata is already attached to the data you selected, as described in the [[https://wiki.hpc.rug.nl/rdms/metadata/metadatawebportal#read_metadata|Read Metadata section]]. | When you first upload a file to the RDMS, all the metadata attached to it will be related to system information, such as upload time and file size, as shown above. You can easily attach new metadata to your data by right-clicking the object or collection you wish to add metadata to and then selecting ''Add Metadata''. If you click any of the {{:rdms:webapp:interface_info_button.png?20|}} icons highlighted in the screenshot below, the web portal will open a side menu containing all information about the selected data. There you can easily check what metadata is already attached to the data you selected, as described in the [[https://wiki.hpc.rug.nl/rdms/metadata/metadatawebportal#read_metadata|Read Metadata section]]. |
| |
| |
| {{ :rdms:webapp:meta_crud_3.png?800 |}} | {{ :rdms:webapp:meta_crud_3.png?800 |}} |
| | </hidden> |
| |
| ==== Read Metadata ==== | |
| | ==== Read Metadata in the Web Portal ==== |
| | <hidden> |
| Once you created metadata related to your data, you will always be able to display that information by clicking on the {{:rdms:webapp:interface_info_button.png?20|}} icon next to the respective entry in the web portal. In the screenshot below, clicking on the icon in the red box will display the metadata for the selected object, while clicking on the icon in the blue box will display the information of the current collection, in this case the user's home collection. | Once you created metadata related to your data, you will always be able to display that information by clicking on the {{:rdms:webapp:interface_info_button.png?20|}} icon next to the respective entry in the web portal. In the screenshot below, clicking on the icon in the red box will display the metadata for the selected object, while clicking on the icon in the blue box will display the information of the current collection, in this case the user's home collection. |
| |
| |
| {{ :rdms:webapp:meta_crud_5.png?800 |}} | {{ :rdms:webapp:meta_crud_5.png?800 |}} |
| | </hidden> |
| |
| ==== Update Metadata ==== | ==== Update Metadata in the Web Portal ==== |
| | <hidden> |
| Whether it be because you do not always have all the details related to certain data at the time of its storage in the RDMS or because you spot an error, you can change or update metadata you attached to an object or collection in the way described below. | Whether it be because you do not always have all the details related to certain data at the time of its storage in the RDMS or because you spot an error, you can change or update metadata you attached to an object or collection in the way described below. |
| |
| |
| {{ :rdms:webapp:meta_crud_7.png?800 |}} | {{ :rdms:webapp:meta_crud_7.png?800 |}} |
| ==== Delete Metadata ==== | </hidden> |
| | |
| | ==== Delete Metadata in the Web Portal ==== |
| | <hidden> |
| During your data's life cycle, errors can occur or metadata tags can become irrelevant. For those cases, you can easily delete a metadata tag by selecting the {{:rdms:webapp:interface_info_button.png?20|}} icon once again and clicking on the {{:rdms:webapp:delete_icon.png?30|}} button next to a metadata entry in the metadata tab in the right-side window. | During your data's life cycle, errors can occur or metadata tags can become irrelevant. For those cases, you can easily delete a metadata tag by selecting the {{:rdms:webapp:interface_info_button.png?20|}} icon once again and clicking on the {{:rdms:webapp:delete_icon.png?30|}} button next to a metadata entry in the metadata tab in the right-side window. |
| |
| |
| {{ :rdms:webapp:meta_crud_9.png?800 |}} | {{ :rdms:webapp:meta_crud_9.png?800 |}} |
| | </hidden> |
| |
| | ===== Automatic Extraction of Metadata ===== |
| |
| | What we described above is the functionality of the web portal to let the user add metadata entries by hand. However, there are files which require a large amount of metadata to be properly described. Such data often has the information needed to describe stored as metadata in their file header. The web portal offers the user the possibility to extract and import the metadata contained in the file header directly into the RDMS. |
| |
| | To access this functionality, right-click the file you wish to extract metadata from, then scroll down the menu to ''Extract metadata''. |
| |
| | {{ :rdms:webapp:meta_extract_1.png?800 |}} |
| |
| | Once you click on the menu item, the system will display the message below to inform you of the formats that are currently supported for automatic metadata extraction. To check if the extraction was successful, follow the same steps as in [[https://wiki.hpc.rug.nl/rdms/metadata/metadatawebportal#read_metadata|Read Metadata]] and verify that the header in your file and the metadata in the RDMS overlap. |
| |
| | {{ :rdms:webapp:meta_extract_2.png?800 |}} |
| |
| | **Note**: The extract function of the web portal extracts information contained in the file header. If your file does not have a header, no information will be extracted, even when the system reports successfully finishing the extraction. |
| |
| | ==== Supported File Formats for automated Metadata Extraction ==== |
| ====== Automatic extraction of metadata ====== | |
| | |
| What we described above is the functionality of the web portal to let the user add metadata entries by hand. There are data objects or collections, however, which require a large amount of metadata to be properly described. Such data objects often have the information needed to describe them stored in their file header. The web portal offers the user the possibility to extract and import the metadata contained in the file header directly into the RDMS system. Contrary to the manual input, this action generates a single metadata entry for multiple values, similarly to what you would get by inputting values into a template. | |
| | |
| {{ :rdms:webapp:meta_extract_1.png?800 |}} | |
| | |
| To access this functionality, right-click the file you wish to extract metadata from, then scroll down the menu to ''Extract metadata''. Once you click on the menu item, the system will display the message below to inform you of the formats that are currently supported for automatic metadata extraction. To check if the extraction was successful, follow the same steps as in [[https://wiki.hpc.rug.nl/rdms/metadata/metadatawebportal#read_metadata|Read Metadata]] and verify that the header in your file and the metadata in the RDMS overlap. | |
| | |
| **N.B.**: The extract function of the web portal extracts information contained in the file header. If your file does not have a header, no information will be extracted, even when the system reports successfully finishing the extraction. | |
| | |
| {{ :rdms:webapp:meta_extract_2.png?800 |}} | |
| |
| Below you can find the list of file extension for which automatic extraction is supported: | Below you can find the list of file extension for which automatic extraction is supported: |
| |
| * 'dcm' , 'dcm30': 'description': 'DICOM (Digital Imaging and Communications in Medicine) image','reference': 'dicomstandard.org', | * ''.dcm'' , ''.dcm30'': DICOM (Digital Imaging and Communications in Medicine) images (dicomstandard.org) |
| * 'doc', 'docx': 'description': 'Microsoft Word document', -'reference': 'microsoft.com', | * ''.doc'', ''.docx'': Microsoft Word documents (microsoft.com) |
| * 'fits', 'fit': 'description': 'FITS (Flexible Image Transport System) image', -'reference': 'fits.gsfc.nasa.gov', | * ''.fits'', ''.fit'': FITS (Flexible Image Transport System) images (fits.gsfc.nasa.gov) |
| * 'hdr', 'nii': 'description': 'NIfTI (Neuroimaging Informatics Technology Initiative) header', -'reference': 'nifti.nimh.nih.gov', | * ''.hdr'', ''.nii'': NIfTI (Neuroimaging Informatics Technology Initiative) headers (nifti.nimh.nih.gov) |
| * 'jpeg', 'jpg' : 'description': 'Exif (Exchangeable image file format)', -'reference': 'en.wikipedia.org/wiki/Exif', | * ''.jpeg'', ''.jpg'' : Exif (Exchangeable image file format) (en.wikipedia.org/wiki/Exif) |
| * 'pdf': -'description': 'PDF (Portable Document Format) file', -'reference': 'adobe.com/acrobat/about-adobe-pdf.html', | * ''.pdf'': -'description': PDF (Portable Document Format) files (adobe.com/acrobat/about-adobe-pdf.html) |
| * 'ppt', 'pptx' -'description': 'Microsoft Powerpoint document', -'reference': 'microsoft.com', | * ''.ppt'', ''.pptx'': Microsoft Powerpoint documents (microsoft.com) |
| * 'tif', 'tiff': -'description': 'Exif (Exchangeable image file format)', -'reference': 'en.wikipedia.org/wiki/Exif', | * ''.tif'', ''.tiff'': Exif (Exchangeable image file format) (en.wikipedia.org/wiki/Exif) |
| * 'txt': -'description': 'ASCII text file containing key=value pairs', -'reference': '', | * ''.txt'': ASCII text files containing key=value pairs |
| * 'xls', 'xlsx' -'description': 'Microsoft Excel document', -'reference': 'microsoft.com', | * ''.xls'', ''.xlsx'': Microsoft Excel documents (microsoft.com) |
| |
| If the file type you wish to extract metadata from has a readable file structure and is not present in the list above, we can probably add that file type to the list of supported extensions. Please send an e-mail to [[rdms-support@rug.nl|RDMS support]] to let us know that you wish for a file type to be added to the list. | If the file type you wish to extract metadata from has a readable file structure and is not present in the list above, we can probably add that file type to the list of supported extensions. Please send an e-mail to [[rdms-support@rug.nl|RDMS support]] to let us know that you wish for a file type to be added to the list. |
| |
| |
| ====== Import metadata ====== | ===== Import Metadata ===== |
| |
| Metadata can also be imported from a local file using the web portal. The AVUs (Attribute, Value, Unit combination) are defined in a so-called JSON structure as a .txt file or a .json file. Multiple AVUs can be added at once with this approach. | Metadata can also be imported from a local file using the web portal. The ''Name'', ''Value'', and ''Extra Value'' are called AVUs for Attribute, Value, Unit combinations in this context. AVUs are defined in a so-called JSON structure as a ''.txt'' file or a ''.json'' file. Multiple AVUs can be added at once with this approach. |
| |
| The structure of the file should be as followed: | The structure of the file should be as followed: |
| </code> | </code> |
| |
| Metadata from a local file can be added to both collections and objects by right clicking the target of interest and selecting the "Load metadata" option. | Metadata from a local file can be added to both collections and objects by right clicking the target of interest and selecting the ''Load metadata'' option. |
| |
| \\ | {{ :rdms:metadata:import_1_new.png?800 |}} |
| {{ :rdms:metadata:import_1.png?1200 |}} | |
| |
| \\ | Upon selecting a file with AVUs in a JSON structure as indicated above, the metadata is automatically recognized and can be added by selecting the ''Load metadata'' button. In this example a .txt file was used. **Please note that multiple AVUs can be added at once.** |
| \\ | |
| Upon selecting a file with AVUs in a JSON structure as indicated above, the metadata is automatically recognized and can be added by selecting the "Load metadata" button. In this example a .txt file was used. **Please note that multiple AVUs can be added at once.** | |
| |
| \\ | {{ :rdms:metadata:import_2_new.png?800 |}} |
| {{ :rdms:metadata:import_2.png?1200 |}} | |
| |
| \\ | Upon loading the AVU file the metadata is displayed for the selected data. |
| \\ | |
| Indeed, upon loading the AVU file the metadata is displayed with, in this case, the collection of interest. | |
| |
| \\ | {{ :rdms:metadata:import_3_new.png?800 |}} |
| {{ :rdms:metadata:import_3.png?1200 |}} | |