noresm:norstoretape

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
noresm:norstoretape [2014-10-24 15:20:06]
ingo.bethke@gmail.com
noresm:norstoretape [2022-05-31 09:29:32] (current)
Line 9: Line 9:
 A collection of high-level tape tools is available in **/projects/NS2345K/tools**. A collection of high-level tape tools is available in **/projects/NS2345K/tools**.
  
-==== disk2tape ====+==== noresm2tape ====
  
-disk2tape is a script for copying a folder from NorStore's disk area to NorStore's tape resource. +noresm2tape copies the output of a NorESM case from NorStore's disk area to NorStore's tape resource. The output folder should be organised in the standard CCSM way (e.g., atmospheric output is expected in 'atm/hist'). If that is not the case, please use the command disk2tape instead.
  
 +**IMPORTANT:** It is highly recommended to run the script in background using the nohup command, e.g., 
 + "''nohup /projects/NS2345K/tools/noresm2tape <path on disk> <path on tape> &''". Make sure not to forget the "&" at the end of the line. After submitting the script with nohup, it is safe to log out. You will receive a notification email when the transfer to tape is completed.   
 +
 +
 +Run ''/projects/NS2345K/tools/noresm2tape -h'' to print detailed instructions:
 +<file>
 +
 +Usage: noresm2tape <path on disk> <path on tape> <chunk size> <replication flag>
 + 
 +Example: noresm2tape /scratch/ingo/mycase /tape/NS2345K/cases/mycase auto replica
 + 
 +Purpose: Copies NorESM case output from disk to tape. 
 +
 +Description: <path on disk> and <path on tape> must be full path names (see example). 
 +             
 +             <chunk size> must be one of: auto, all, 1, 10, 100, or 1000 (numbers 
 +             indicate simulation years per chunk)
 +          
 +             <replication flag> must be either 'replica' - resulting in two tape copies -
 +             or 'noreplica'.  
 +                          
 +             The output folder <path on tape> will be created - with parent  
 +             directories if necessary - and must not exist before running this 
 +             script. 
 +
 +             The input data is staged in form of tar-chuncks in 
 +             /scratch/ingo/noresm2tape. The tar-chunks are removed from 
 +             scratch after successfull transfer to tape. 
 +
 +             Checksums for all input files are computed and stored in a separate 
 +             checksum file. The checksums are used to verify the tar-chunks.  
 +</file>
 +
 +
 +==== disk2tape ====
 +
 +disk2tape copies a folder from NorStore's disk area to NorStore's tape resource. In contrast to noresm2tape, the data folder can have any structure and content. 
  
 **IMPORTANT:** It is highly recommended to run the script in background using the nohup command, e.g.,  **IMPORTANT:** It is highly recommended to run the script in background using the nohup command, e.g., 
  "''nohup /projects/NS2345K/tools/disk2tape <path on disk> <path on tape> &''". Make sure not to forget the "&" at the end of the line. After submitting the script with nohup, it is safe to log out. You will receive a notification email when the transfer to tape is completed.     "''nohup /projects/NS2345K/tools/disk2tape <path on disk> <path on tape> &''". Make sure not to forget the "&" at the end of the line. After submitting the script with nohup, it is safe to log out. You will receive a notification email when the transfer to tape is completed.   
- 
  
 Run ''/projects/NS2345K/tools/disk2tape -h'' to print detailed instructions: Run ''/projects/NS2345K/tools/disk2tape -h'' to print detailed instructions:
Line 53: Line 89:
 ==== tape2disk ==== ==== tape2disk ====
  
-tape2disk is a script for retrieve a folder from NorStore's tape area. All tar-archieves are unpacked.  +tape2disk copies a folder that had been put on tape with either noresm2tape or disk2tape. All tar-archieves found in the top-level folder are unpacked while tar-files stored within tar-files are not inflated.  
  
 Run ''/projects/NS2345K/tools/tape2disk -h'' to print detailed instructions: Run ''/projects/NS2345K/tools/tape2disk -h'' to print detailed instructions:
Line 70: Line 106:
 ==== listontape ==== ==== listontape ====
  
-listontape is a script list all files that are archived in a tape folder. +listontape lists all files that are archived in a tape folder. 
  
 Run ''/projects/NS2345K/tools/listontape -h'' to print detailed instructions: Run ''/projects/NS2345K/tools/listontape -h'' to print detailed instructions:
  • noresm/norstoretape.1414164006.txt.gz
  • Last modified: 2022-05-31 09:23:24
  • (external edit)