Differences
This shows you the differences between two versions of the page.
noresm:norstoreesg [2014-04-24 12:57:12] ingo.bethke@gmail.com |
noresm:norstoreesg [2022-05-31 09:29:32] |
||
---|---|---|---|
Line 1: | Line 1: | ||
- | ====== Data sharing via NorStore' | ||
- | |||
- | ===== Basic use ===== | ||
- | |||
- | All users of the NorStore project ns2345k have the possibility to share their data via NorStore' | ||
- | |||
- | Requirements are: | ||
- | * the data needs to reside in / | ||
- | * only netcdf files are considered | ||
- | * all files must be regular (i.e., no symbolic links) | ||
- | * file names must all be unique (folder hierarchy is flattened during publication) | ||
- | * reading permissions of data files must be open to everyone (does not apply to folders) | ||
- | |||
- | Note that the data sharing solution uses hard links to avoid additional use of disk resources. The original data is not touched/ | ||
- | |||
- | ==== Publishing a simple dataset to NorStore' | ||
- | |||
- | For simple data sharing, use the script / | ||
- | < | ||
- | Usage: esgpublish <path to data directory> | ||
- | |||
- | Example: esgpublish / | ||
- | |||
- | Purpose: Publish data via NorStore' | ||
- | |||
- | Description: | ||
- | |||
- | Only regular files (i.e., no symbolic links) of netcdf format are | ||
- | | ||
- | | ||
- | All date files must have unique names as the folder stucture is | ||
- | | ||
- | |||
- | | ||
- | but reading permissions of the folders containing the files can be | ||
- | | ||
- | | ||
- | < | ||
- | | ||
- | |||
- | Change history: 2014.04.24 first version of esgpublish | ||
- | </ | ||
- | |||
- | ==== Removing a simple dataset from NorStore' | ||
- | |||
- | To unpublish a dataset that previously has been published with esgpublish, use the script / | ||
- | < | ||
- | Usage: esgunpublish <dataset name> | ||
- | |||
- | Example: esgunpublish CORE2-AMOC | ||
- | |||
- | Purpose: Unpublish a dataset from NorStore' | ||
- | |||
- | Change history: 2014.04.24 first version of esgunpublish | ||
- | </ | ||
- | |||
- | ===== Advanced use ===== | ||
- | |||
- | Several projects (e.g, CMIP, GeoMIP, etc) require special post-processing and ESG publishing procedures. | ||
- | |||
- | Please contact Ingo Bethke (ingo.bethke[at]uni.no) or Alf Grini (alfg[at]met.no) for assistance. | ||
- | |||