User Tools

Site Tools


noresm:norstoreesg

This is an old revision of the document!


Data sharing via NorStore's Earth System Grid data portal

Basic use

All users of the NorStore project ns2345k have the possibility to share their data via NorStore's ESG data portal http://noresg.norstore.no.

Requirements are:

  • the data needs to reside in /projects/ns2345k
  • only netcdf files are considered
  • all files must be regular (i.e., no symbolic links)
  • file names must all be unique (folder hierarchy is flattened during publication)
  • reading permissions of data files must be open to everyone (does not apply to folders)

Note that the data sharing solution uses hard links to avoid additional use of disk resources. The original data is not touched/modified.

Publishing a simple dataset to NorStore's ESG data portal

For simple data sharing, use the script /projects/NS2345K/tools/esgpublish:

Usage: esgpublish <path to data directory> <dataset name> 

Example: esgpublish /projects/NS2345K/noresm/thredds/CORE2/AMOC CORE2-AMOC 
 
Purpose: Publish data via NorStore's online data portal http://noresg.norstore.no 

Description: The data folder must be in the project folder /projects/NS2345K.  

             Only regular files (i.e., no symbolic links) of netcdf format are 
             considered. 
          
             All date files must have unique names as the folder stucture is 
             flattened during publication. 

             Reading permissions of the data files have to be open to everyone, 
             but reading permissions of the folders containing the files can be 
             closed. 
              
             <dataset name> should be one word and not contain special 
             characters other than "-" and "_". 

Change history: 2014.04.24 first version of esgpublish

Removing a simple dataset from NorStore's ESG data portal

To unpublish a dataset that previously has been published with esgpublish, use the script /projects/NS2345K/tools/esgunpublish:

Usage: esgunpublish <dataset name> 

Example: esgunpublish CORE2-AMOC 
 
Purpose: Unpublish a dataset from NorStore's online data portal http://noresg.norstore.no 

Change history: 2014.04.24 first version of esgunpublish

Advanced use

Several projects (e.g, CMIP, GeoMIP, etc) require special post-processing and ESG publishing procedures.

Please contact Ingo Bethke (ingo.bethke[at]uni.no) or Alf Grini (alfg[at]met.no) for assistance.

noresm/norstoreesg.1398344232.txt.gz · Last modified: (external edit)