noresm:norstoreesg

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

noresm:norstoreesg [2014-04-24 12:57:12]
ingo.bethke@gmail.com
noresm:norstoreesg [2022-05-31 09:29:32]
Line 1: Line 1:
-====== Data sharing via NorStore's Earth System Grid data portal ====== 
- 
-===== Basic use ===== 
- 
-All users of the NorStore project ns2345k have the possibility to share their data via NorStore's ESG data portal [[http://noresg.norstore.no|http://noresg.norstore.no]].  
- 
-Requirements are: 
-  * the data needs to reside in /projects/ns2345k 
-  * only netcdf files are considered  
-  * all files must be regular (i.e., no symbolic links)  
-  * file names must all be unique (folder hierarchy is flattened during publication) 
-  * reading permissions of data files must be open to everyone (does not apply to folders) 
- 
-Note that the data sharing solution uses hard links to avoid additional use of disk resources. The original data is not touched/modified. 
- 
-==== Publishing a simple dataset to NorStore's ESG data portal ==== 
- 
-For simple data sharing, use the script /projects/NS2345K/tools/esgpublish:  
-<file> 
-Usage: esgpublish <path to data directory> <dataset name>  
- 
-Example: esgpublish /projects/NS2345K/noresm/thredds/CORE2/AMOC CORE2-AMOC  
-  
-Purpose: Publish data via NorStore's online data portal http://noresg.norstore.no  
- 
-Description: The data folder must be in the project folder /projects/NS2345K.   
- 
-             Only regular files (i.e., no symbolic links) of netcdf format are  
-             considered.  
-           
-             All date files must have unique names as the folder stucture is  
-             flattened during publication.  
- 
-             Reading permissions of the data files have to be open to everyone,  
-             but reading permissions of the folders containing the files can be  
-             closed.  
-               
-             <dataset name> should be one word and not contain special  
-             characters other than "-" and "_" 
- 
-Change history: 2014.04.24 first version of esgpublish 
-</file>  
- 
-==== Removing a simple dataset from NorStore's ESG data portal ==== 
- 
-To unpublish a dataset that previously has been published with esgpublish, use the script /projects/NS2345K/tools/esgunpublish:  
-<file> 
-Usage: esgunpublish <dataset name>  
- 
-Example: esgunpublish CORE2-AMOC  
-  
-Purpose: Unpublish a dataset from NorStore's online data portal http://noresg.norstore.no  
- 
-Change history: 2014.04.24 first version of esgunpublish 
-</file> 
- 
-===== Advanced use ===== 
- 
-Several projects (e.g, CMIP, GeoMIP, etc) require special post-processing and ESG publishing procedures.  
- 
-Please contact Ingo Bethke (ingo.bethke[at]uni.no) or Alf Grini (alfg[at]met.no) for assistance. 
- 
  
  • noresm/norstoreesg.txt
  • Last modified: 2022-05-31 09:29:32
  • (external edit)