noresm:norstoreesg

This is an old revision of the document!


Simple data sharing

For simple data sharing, use the script /projects/NS2345K/tools/wwwpublish:



If you don't want to share a dataset anymore, use the script /projects/NS2345K/tools/wwwunpublish:

Data sharing via the Norwegian ESG data portal

All users of the NorStore project ns2345k have the possibility to share their data via NorStore's ESG data portal http://noresg.norstore.no.

Requirements are:

  • the data has to reside in /projects/NS2345K (same as /norstore_osl/projects/NS2345K)
  • all files must be regular (i.e., no symbolic links)
  • file names must all be unique (folder hierarchy is flattened during publication)
  • reading permissions of data files must be open to everyone (does not apply to their parent folders)

Note that the data sharing solution uses hard links to avoid additional use of disk resources. The original data is not touched/modified.

For simple data sharing with ESG support, use the script /projects/NS2345K/tools/esgpublish:

Usage: esgpublish <absolute path to data directory> <dataset name> [unlisted]
       or 
       esgpublish <absolute path to data file> <dataset name> [unlisted]

Example: esgpublish /projects/NS2345K/noresm/thredds/CORE2/AMOC CORE2-AMOC 
         or
         esgpublish /projects/NS2345K/noresm/noresm2cmor.tbz noresm2cmor unlisted 

Purpose: Publish data via NorStore's online data portal http://noresg.norstore.no 

Description: The input path must be absolute and start with /projects/NS2345K or
             /norstore_osl/projects/NS2345K.  

             Only regular files (i.e., no symbolic links) are considered. 
          
             All date files must have unique names as the folder stucture is 
             flattened during publication. 

             Reading permissions of the data files have to be open to everyone, 
             but reading permissions of the folders containing the files can be 
             closed. 
              
             <dataset name> should be one word and not contain any special 
             characters other than "-" and "_". 
           
             If a third argument is specified and set to "unlisted" then the 
             dataset will be served through the file server but not published 
             to the portal.             

To unpublish a dataset that previously has been published with esgpublish, use the script /projects/NS2345K/tools/esgunpublish:

Usage: esgunpublish <dataset name> 

Example: esgunpublish CORE2-AMOC 
 
Purpose: Unpublish a dataset from NorStore's online data portal http://noresg.norstore.no 

Several projects (e.g, CMIP, GeoMIP, etc) require special post-processing and ESG publishing procedures.

Please contact Ingo Bethke (ingo.bethke[at]uni.no) or Alf Grini (alfg[at]met.no) for assistance.

This website uses cookies. By using the website, you agree with storing cookies on your computer. Also you acknowledge that you have read and understand our Privacy Policy. If you do not agree leave the website.More information about cookies
  • noresm/norstoreesg.1443686483.txt.gz
  • Last modified: 2022-05-31 09:23:24
  • (external edit)