| Both sides previous revision
 Previous revision
 Next revision | Previous revision | 
                        
                | noresm:norstoretape [2014-10-24 15:20:06] ingo.bethke@gmail.com
 | noresm:norstoretape [2022-05-31 09:29:32] (current) 
 | 
        
| A collection of high-level tape tools is available in **/projects/NS2345K/tools**. | A collection of high-level tape tools is available in **/projects/NS2345K/tools**. | 
|  |  | 
| ==== disk2tape ==== | ==== noresm2tape ==== | 
|  |  | 
| disk2tape is a script for copying a folder from NorStore's disk area to NorStore's tape resource. | noresm2tape copies the output of a NorESM case from NorStore's disk area to NorStore's tape resource. The output folder should be organised in the standard CCSM way (e.g., atmospheric output is expected in 'atm/hist'). If that is not the case, please use the command disk2tape instead. | 
|  |  | 
|  | **IMPORTANT:** It is highly recommended to run the script in background using the nohup command, e.g., | 
|  | "''nohup /projects/NS2345K/tools/noresm2tape <path on disk> <path on tape> &''". Make sure not to forget the "&" at the end of the line. After submitting the script with nohup, it is safe to log out. You will receive a notification email when the transfer to tape is completed. | 
|  |  | 
|  |  | 
|  | Run ''/projects/NS2345K/tools/noresm2tape -h'' to print detailed instructions: | 
|  | <file> | 
|  |  | 
|  | Usage: noresm2tape <path on disk> <path on tape> <chunk size> <replication flag> | 
|  |  | 
|  | Example: noresm2tape /scratch/ingo/mycase /tape/NS2345K/cases/mycase auto replica | 
|  |  | 
|  | Purpose: Copies NorESM case output from disk to tape. | 
|  |  | 
|  | Description: <path on disk> and <path on tape> must be full path names (see example). | 
|  |  | 
|  | <chunk size> must be one of: auto, all, 1, 10, 100, or 1000 (numbers | 
|  | indicate simulation years per chunk) | 
|  |  | 
|  | <replication flag> must be either 'replica' - resulting in two tape copies - | 
|  | or 'noreplica'. | 
|  |  | 
|  | The output folder <path on tape> will be created - with parent | 
|  | directories if necessary - and must not exist before running this | 
|  | script. | 
|  |  | 
|  | The input data is staged in form of tar-chuncks in | 
|  | /scratch/ingo/noresm2tape. The tar-chunks are removed from | 
|  | scratch after successfull transfer to tape. | 
|  |  | 
|  | Checksums for all input files are computed and stored in a separate | 
|  | checksum file. The checksums are used to verify the tar-chunks. | 
|  | </file> | 
|  |  | 
|  |  | 
|  | ==== disk2tape ==== | 
|  |  | 
|  | disk2tape copies a folder from NorStore's disk area to NorStore's tape resource. In contrast to noresm2tape, the data folder can have any structure and content. | 
|  |  | 
| **IMPORTANT:** It is highly recommended to run the script in background using the nohup command, e.g., | **IMPORTANT:** It is highly recommended to run the script in background using the nohup command, e.g., | 
| "''nohup /projects/NS2345K/tools/disk2tape <path on disk> <path on tape> &''". Make sure not to forget the "&" at the end of the line. After submitting the script with nohup, it is safe to log out. You will receive a notification email when the transfer to tape is completed. | "''nohup /projects/NS2345K/tools/disk2tape <path on disk> <path on tape> &''". Make sure not to forget the "&" at the end of the line. After submitting the script with nohup, it is safe to log out. You will receive a notification email when the transfer to tape is completed. | 
|  |  | 
|  |  | 
| Run ''/projects/NS2345K/tools/disk2tape -h'' to print detailed instructions: | Run ''/projects/NS2345K/tools/disk2tape -h'' to print detailed instructions: | 
| ==== tape2disk ==== | ==== tape2disk ==== | 
|  |  | 
| tape2disk is a script for retrieve a folder from NorStore's tape area. All tar-archieves are unpacked. | tape2disk copies a folder that had been put on tape with either noresm2tape or disk2tape. All tar-archieves found in the top-level folder are unpacked while tar-files stored within tar-files are not inflated. | 
|  |  | 
| Run ''/projects/NS2345K/tools/tape2disk -h'' to print detailed instructions: | Run ''/projects/NS2345K/tools/tape2disk -h'' to print detailed instructions: | 
| ==== listontape ==== | ==== listontape ==== | 
|  |  | 
| listontape is a script list all files that are archived in a tape folder. | listontape lists all files that are archived in a tape folder. | 
|  |  | 
| Run ''/projects/NS2345K/tools/listontape -h'' to print detailed instructions: | Run ''/projects/NS2345K/tools/listontape -h'' to print detailed instructions: |