Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision 		Previous revision
rdms:metadata:metadatawebportal [2023/09/12 11:51]
jelte Introduced hidden sections for CRUD 		rdms:metadata:metadatawebportal [2023/09/13 10:36] (current)
pascal [Import Metadata]
Line 75: Line 75:
 ===== Automatic Extraction of Metadata ===== ===== Automatic Extraction of Metadata =====
  
-What we described above is the functionality of the web portal to let the user add metadata entries by hand. There are data objects or collections, however, which require a large amount of metadata to be properly described. Such data objects often have the information needed to describe them stored in their file header. The web portal offers the user the possibility to extract and import the metadata contained in the file header directly into the RDMS system. Contrary to the manual input, this action generates a single metadata entry for multiple values, similarly to what you would get by inputting values into a template.+What we described above is the functionality of the web portal to let the user add metadata entries by hand. However, there are files which require a large amount of metadata to be properly described. Such data often has the information needed to describe  stored as metadata in their file header. The web portal offers the user the possibility to extract and import the metadata contained in the file header directly into the RDMS.  
 + 
 +To access this functionality, right-click the file you wish to extract metadata from, then scroll down the menu to ''Extract metadata''.
  
 {{ :rdms:webapp:meta_extract_1.png?800 |}} {{ :rdms:webapp:meta_extract_1.png?800 |}}
  
-To access this functionality, right-click the file you wish to extract metadata from, then scroll down the menu to ''Extract metadata''. Once you click on the menu item, the system will display the message below to inform you of the formats that are currently supported for automatic metadata extraction. To check if the extraction was successful, follow the same steps as in [[https://wiki.hpc.rug.nl/rdms/metadata/metadatawebportal#read_metadata|Read Metadata]] and verify that the header in your file and the metadata in the RDMS overlap. + Once you click on the menu item, the system will display the message below to inform you of the formats that are currently supported for automatic metadata extraction. To check if the extraction was successful, follow the same steps as in [[https://wiki.hpc.rug.nl/rdms/metadata/metadatawebportal#read_metadata|Read Metadata]] and verify that the header in your file and the metadata in the RDMS overlap.
- +
-**N.B.**: The extract function of the web portal extracts information contained in the file header. If your file does not have a header, no information will be extracted, even when the system reports successfully finishing the extraction.+
  
 {{ :rdms:webapp:meta_extract_2.png?800 |}} {{ :rdms:webapp:meta_extract_2.png?800 |}}
 +
 +**Note**: The extract function of the web portal extracts information contained in the file header. If your file does not have a header, no information will be extracted, even when the system reports successfully finishing the extraction.
 +
 +==== Supported File Formats for automated Metadata Extraction ====
  
 Below you can find the list of file extension for which automatic extraction is supported:  Below you can find the list of file extension for which automatic extraction is supported: 
  
-  *    'dcm' , 'dcm30': 'description': 'DICOM (Digital Imaging and Communications in Medicine) image','reference': 'dicomstandard.org', +  *    ''.dcm'' , ''.dcm30'': DICOM (Digital Imaging and Communications in Medicine) images (dicomstandard.org) 
-  *     'doc', 'docx': 'description': 'Microsoft Word document', -'reference': 'microsoft.com', +  *     ''.doc'', ''.docx'': Microsoft Word documents (microsoft.com) 
-  *     'fits', 'fit': 'description': 'FITS (Flexible Image Transport System) image', -'reference': 'fits.gsfc.nasa.gov', +  *     ''.fits'', ''.fit'': FITS (Flexible Image Transport System) images (fits.gsfc.nasa.gov) 
-  *     'hdr', 'nii': 'description': 'NIfTI (Neuroimaging Informatics Technology Initiative) header', -'reference': 'nifti.nimh.nih.gov', +  *     ''.hdr'', ''.nii'': NIfTI (Neuroimaging Informatics Technology Initiative) headers (nifti.nimh.nih.gov) 
-  *     'jpeg', 'jpg' : 'description': 'Exif (Exchangeable image file format)', -'reference': 'en.wikipedia.org/wiki/Exif', +  *     ''.jpeg'', ''.jpg'' : Exif (Exchangeable image file format) (en.wikipedia.org/wiki/Exif) 
-  *     'pdf': -'description': 'PDF (Portable Document Format) file', -'reference': 'adobe.com/acrobat/about-adobe-pdf.html', +  *     ''.pdf'': -'description': PDF (Portable Document Format) files (adobe.com/acrobat/about-adobe-pdf.html) 
-  *     'ppt', 'pptx' -'description': 'Microsoft Powerpoint document', -'reference': 'microsoft.com', +  *     ''.ppt'', ''.pptx'': Microsoft Powerpoint documents (microsoft.com) 
-  *     'tif', 'tiff': -'description': 'Exif (Exchangeable image file format)', -'reference': 'en.wikipedia.org/wiki/Exif', +  *     ''.tif'', ''.tiff'': Exif (Exchangeable image file format) (en.wikipedia.org/wiki/Exif) 
-  *     'txt': -'description': 'ASCII text file containing key=value pairs', -'reference': , +  *     ''.txt'': ASCII text files containing key=value pairs 
-  *     'xls', 'xlsx' -'description': 'Microsoft Excel document', -'reference': 'microsoft.com',+  *     ''.xls'', ''.xlsx'': Microsoft Excel documents (microsoft.com)
  
 If the file type you wish to extract metadata from has a readable file structure and is not present in the list above, we can probably add that file type to the list of supported extensions. Please send an e-mail to [[rdms-support@rug.nl|RDMS support]] to let us know that you wish for a file type to be added to the list.  If the file type you wish to extract metadata from has a readable file structure and is not present in the list above, we can probably add that file type to the list of supported extensions. Please send an e-mail to [[rdms-support@rug.nl|RDMS support]] to let us know that you wish for a file type to be added to the list. 
Line 103: Line 107:
 ===== Import Metadata ===== ===== Import Metadata =====
  
-Metadata can also be imported from a local file using the web portal. The AVUs (Attribute, Value, Unit combination) are defined in a so-called JSON structure as a .txt file or a .json file. Multiple AVUs can be added at once with this approach. +Metadata can also be imported from a local file using the web portal. The ''Name'', ''Value'', and ''Extra Value'' are called AVUs for  Attribute, Value, Unit combinations in this context. AVUs are defined in a so-called JSON structure as a ''.txt'' file or a ''.json'' file. Multiple AVUs can be added at once with this approach. 
  
 The structure of the file should be as followed: The structure of the file should be as followed:
Line 125: Line 129:
 Metadata from a local file can be added to both collections and objects by right clicking the target of interest and selecting the ''Load metadata'' option. Metadata from a local file can be added to both collections and objects by right clicking the target of interest and selecting the ''Load metadata'' option.
  
- \\  +{{ :rdms:metadata:import_1_new.png?800 |}}
-{{ :rdms:metadata:import_1.png?1200 |}}+
  
- \\  
- \\  
 Upon selecting a file with AVUs in a JSON structure as indicated above, the metadata is automatically recognized and can be added by selecting the ''Load metadata'' button. In this example a .txt file was used. **Please note that multiple AVUs can be added at once.** Upon selecting a file with AVUs in a JSON structure as indicated above, the metadata is automatically recognized and can be added by selecting the ''Load metadata'' button. In this example a .txt file was used. **Please note that multiple AVUs can be added at once.**
  
- \\  +{{ :rdms:metadata:import_2_new.png?800 |}}
-{{ :rdms:metadata:import_2.png?1200 |}}+
  
- \\ +Upon loading the AVU file the metadata is displayed for the selected data.
- \\  +
-Indeed, upon loading the AVU file the metadata is displayed with, in this case, the collection of interest.+
  
- \\  +{{ :rdms:metadata:import_3_new.png?800 |}}
-{{ :rdms:metadata:import_3.png?1200 |}}+