noresm:norstoreesg

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
noresm:norstoreesg [2015-09-30 15:12:51]
ingo.bethke@gmail.com
noresm:norstoreesg [2017-09-20 13:59:46]
ingo.bethke@gmail.com
Line 1: Line 1:
-====== Data sharing via the Norwegian ESG data portal (IMPORTANT: The portal is currently offline for maintenance. We expect to resume its operation sometime in October)======+ 
 +====== Simple online sharing ====== 
 + 
 +===== Share data online ===== 
 + 
 +For simple data sharing, use the script **/projects/NS2345K/tools/wwwpublish**:  
 +<file> 
 +Usage:        
 +   wwwpublish <absolute path to data directory> <dataset name>  
 +   or  
 +   wwwpublish <absolute path to data file> <dataset name>  
 + 
 +Example:  
 +   wwwpublish /projects/NS2345K/noresm/thredds/CORE2/AMOC CORE2-AMOC  
 +   or 
 +   wwwpublish /projects/NS2345K/noresm/noresm2cmor.tbz noresm2cmor  
 + 
 +Purpose:  
 +   Publish data online at http://ns2345k.web.nird.no  
 + 
 +Description:  
 +   The input path must be absolute and start with /projects/NS2345K. 
 + 
 +   Only regular files are considered. Symbolic links are skipped. 
 +           
 +   All date files must have unique names as the folder stucture is  
 +   flattened during publication.  
 + 
 +   Reading permissions of the data files have to be open to everyone.  
 +   However, reading permissions of the folders containing the files  
 +   can be closed.  
 +               
 +   <dataset name> should be one word and not contain any special  
 +   characters other than "-" and "_"           
 +</file> 
 + 
 +The script provides following:  
 +  *local path to a folder that contains hard-links to the data files  
 +  *URL that points to the online-catalogue where the shared files are exposed  
 +  *download-URL to a wget-script that can be used to download the entire dataset (note that execution permissions have to be changed prior to running the script)    
 + 
 +NOTE: The sharing method uses hard-links. This has the advantages that no additional disk space is used and that the sharing happens instantaneous. A removal of the hard-links will unshare the data, but will not affect the original files.    
 + 
 +===== Unshare data ===== 
 + 
 +If you don't want to share a dataset anymore, use the script **/projects/NS2345K/tools/wwwunpublish**:  
 +<file> 
 +Usage: wwwunpublish <dataset name>  
 + 
 +Example: wwwunpublish CORE2-AMOC  
 +  
 +Purpose: Unpublish a dataset from NorStore's www-server  
 +</file> 
 + 
 +NOTE: Unsharing data will not affect the original data.  
 + 
 +====== Data sharing via the Norwegian ESG data portal ====== 
 + 
 +====IMPORTANT: The portal is currently offline for maintenance and its operation is expected to be resumed sometime in October. For an alternative data sharing method see previous section "Simple data sharing"==== 
  
 [[http://noresg.norstore.no|{{ :noresm:noresg.png?nolink&512 |}}]] [[http://noresg.norstore.no|{{ :noresm:noresg.png?nolink&512 |}}]]
Line 17: Line 76:
 ==== Publish a simple dataset to NorStore's ESG data portal ==== ==== Publish a simple dataset to NorStore's ESG data portal ====
  
-For simple data sharing, use the script **/projects/NS2345K/tools/esgpublish**: +For simple data sharing with ESG support, use the script **/projects/NS2345K/tools/esgpublish**: 
 <file> <file>
 Usage: esgpublish <absolute path to data directory> <dataset name> [unlisted] Usage: esgpublish <absolute path to data directory> <dataset name> [unlisted]
  • noresm/norstoreesg.txt
  • Last modified: 2022-05-31 09:29:32
  • (external edit)