Differences
This shows you the differences between two versions of the page.
Both sides previous revision Previous revision Next revision | Previous revision Next revision Both sides next revision | ||
noresm:modeldiagnostics [2016-02-26 11:09:20] annal [Cloud droplet analysis (budgets)] |
noresm:modeldiagnostics [2018-08-15 08:28:03] yanchun.he@nersc.no |
||
---|---|---|---|
Line 1: | Line 1: | ||
====== Model Diagnostic Tools====== | ====== Model Diagnostic Tools====== | ||
- | This page links to tools used for NorESM model evaluation. | + | This page links to tools used for the NorESM model evaluation. |
- | For comparison to older model simulations use the list of available simulations and runs, to be found => | ||
===== NorESM Diagnostic Packages ===== | ===== NorESM Diagnostic Packages ===== | ||
- | Please, refer to GUIDE_ReadME_first and the ReadME files in each of the Model Components Diagnostic Tools (Packages) locations below for more details. | + | Output from the latest NCAR diagnostic pages can be found on nird here: |
- | < | + | via the web: |
- | Usage: nohup [your work directory path]/[amwg/ice_diag]_template.csh >& out & | + | http://ns2345k.web.sigma2.no/ |
- | Purpose: Model solution validation, evaluation, and analysis | + | via the filesystem on nird here: |
- | compared to observations and reference model simulation. | + | / |
- | Description: | ||
- | based on the NCAR CESM diagnostics packages. | ||
- | | ||
- | The packages are installed and stored in 4 locations; please use them on Cruncher or Grunch when possible: | ||
- | On cruncher.uio.no/norstore.uio.no in: | + | The diagnostics packages are currently available on NIRD. Each package can be run/configured from the command line using the program diag_run: |
- | / | + | < |
+ | ------------------------------------------------- | ||
+ | Program: | ||
+ | / | ||
+ | Version: 5.1 | ||
+ | ------------------------------------------------- | ||
+ | Short description: | ||
+ | A wrapper script for NorESM diagnostic packages. | ||
+ | |||
+ | Basic usage: | ||
+ | diag_run -m [model] -c [test case name] -s [test case start yr] -e [test case end yr] # Run model-obs diagnostics | ||
+ | diag_run -m [model] -c [test case name] -s [test case start yr] -e [test case end yr] -c2 [cntl case name] -s2 [cntl case start yr] -e2 [cntl case end yr] # Run model1-model2 diagnostics | ||
+ | nohup / | ||
+ | |||
+ | Command-line options: | ||
+ | -m, --model=MODEL | ||
+ | Valid arguments: | ||
+ | cam : atmospheric package (AMWG) | ||
+ | clm : land package (LMWG) | ||
+ | cice : sea-ice package | ||
+ | micom : ocean package | ||
+ | hamocc : biogeochemistry package | ||
+ | all : configure all available packages. | ||
+ | -c, -c1, --case=CASE1, | ||
+ | -s, -s1, --start_yr=SYR1, | ||
+ | -e, -e1, --end_yr=EYR1, | ||
+ | -c2, --case2=CASE2 | ||
+ | -s2, --start_yr2=SYR2 | ||
+ | -e2, --end_yr2=EYR2 | ||
+ | -i, -i1, --input-dir=DIR, | ||
+ | Default is --input-dir=/ | ||
+ | -i2, --input-dir2=DIR | ||
+ | Default is --input-dir=/ | ||
+ | -o, --output-dir=DIR | ||
+ | Default is --output-dir=/ | ||
+ | -p, --passive-mode | ||
+ | -t, --type=TYPE | ||
+ | Default is to run both. Note that the time series are computed over the entire simulation. | ||
+ | -w, --web-dir=DIR | ||
+ | Default is --web-dir=/ | ||
+ | --no-atm | ||
+ | |||
+ | Examples: | ||
+ | diag_run -m all -c N1850_f19_tn11_exp1 -s 21 -e 50 # model-obs diagnostics of case=N1850_f19_tn11_exp1 (climatology between yrs 21 and 50) for all model components. | ||
+ | diag_run -m cam -c N1850_f19_tn11_exp1 -s 21 -e 50 -w / | ||
+ | diag_run -m micom -c N1850_f19_tn11_exp1 -t time_series # model-obs time-series diagnostics in MICOM for all years represented in the model output directory (/ | ||
+ | diag_run -m cice -c N1850_f19_tn11_exp1 -s 21 -e 50 -p # configure (but do not run) model-obs diagnostics for CICE. | ||
+ | diag_run -m clm -c N1850_f19_tn11_exp1 -s 21 -e 50 -i / | ||
+ | diag_run -m micom -c N1850_f19_tn11_exp1 -s 21 -e 50 -t climo # model-obs climatology diagnostics (no time series) for MICOM: | ||
+ | diag_run -m cam -o /my/dir # install CAM diagnostics in /my/dir with minimal configuration. | ||
+ | diag_run -m micom, | ||
+ | diag_run -m clm -c N1850_f19_tn11_clmexp1 -s 71 -e 100 --no-atm # model-obs time-series diagnostics for an offline (uncoupled) CLM simulation. | ||
+ | diag_run -m hamocc -c N1850OC_f19_tn11_exp1 -s 31 -e 100 -t time_series # model-obs time-series | ||
+ | </file> | ||
+ | A comprehensive technical summary of diag_run (pdf): {{ : | ||
- | On grunch.bccs.uib.no/hexagon.bccs.uib.no in: | + | Report any problems, comments or suggestions to Yanchun He: [[mailto: |
- | /work-common/shared/ | + | === Recent updates === |
+ | * 29.08.10. Update to v5.1: update NCO/NCL versions to support efficient process of compressed netcdf-4 files. | ||
+ | * 29.06.18. Update to v5.0: new fields to HAMOCC and MICOM diagnostics; | ||
+ | * 20.04.18. Update to v4.3: added new fields to HAMOCC diagnostics. | ||
+ | * 19.04.18. Update to v4.2: included ability to do time-series diagnostics between two user-specified years. | ||
+ | * 18.04.18. Update to v4.1: improved climatology and time-series calculations in CLM, and introduction of the --no-atm option to enable diagnostics for offline CLM simulations. | ||
+ | * 09.04.18. Update to v4.0: included the HAMOCC diagnostics package. | ||
+ | * 23.02.18. Update to v3.1: added monthly MLD, seasonal SST/SSS and annual meridional heat/salinity fluxes to the MICOM diagnostics. | ||
+ | * 17.01.18. Update to v3.0: the first version of MICOM diagnostics has been included. | ||
+ | * 28.11.17. Update to v2.0: included a set of time series plots in CAM diagnostics, | ||
- | On vilje.hpc.ntnu.no in: | + | ===Using diag_run with cron=== |
+ | If you want to use diag_run with crontab, you first need to load $HOME/.bash_profile, | ||
+ | < | ||
+ | # | ||
+ | # Min Hour Day Month Weekday Command(s) | ||
+ | # | ||
+ | 50 09 23 11 * . $HOME/ | ||
+ | / | ||
+ | </ | ||
- | / | ||
- | |||
- | There are 6 diagnostic tools CAM_DIAG (ready for use), CICE_DIAG (ready for use), CLM_DIAG (in testing), | ||
- | POP_DIAG (in testing), MICOM_DIAG (in development) and CVDP_DIAG (the new NCAR Climate Package, in testing) | ||
- | |||
- | Currently only the CAM (AMWG) and the CICE packages are ported and ready to use. | ||
- | You will find for each of those c-shell macroscript *_template.csh.[machine] | ||
- | Copy it in your working directory, change the paths and file names in the user-defined part of it and run. | ||
+ | === Other tips === | ||
+ | It is useful to add diag_run as an alias in $HOME/ | ||
+ | < | ||
+ | alias diag_run='/ | ||
</ | </ | ||
- | Report any problems or suggestions to Detelina Ivanova: [[mailto: | ||
- | |||
- | |||
- | ===== MICOM Diagnostic Package ===== | ||
- | |||
- | (NEW 2015.04.23) | ||
- | First version of MICOM diagnostic package is available on grunch/ | ||
- | |||
- | ===== SVN Repository for NorESM Diagnostic Packages | ||
- | |||
- | (NEW 2015.04.23) | ||
- | |||
- | The NorESM Diagnostic Packages can be downloaded via svn using the command: | ||
- | svn export svn:// | ||
- | |||
- | |||
- | A web-viewer is available at [[https:// | ||
+ | === NorESM diagnostics on GitHub === | ||
+ | The NorESM diagnostics packages and diag_run are included in the Git version control repository: | ||
+ | [[https:// | ||
====== Aerosol and Chemistry, Clouds and Forcing Diagnostics ====== | ====== Aerosol and Chemistry, Clouds and Forcing Diagnostics ====== | ||
Line 196: | Line 244: | ||
< | < | ||
- | of the form NorESM-CAM5_svn{RevisionNumber}_YYMMDD{initials}_Freetext. \\ | + | in the required format |
- | Example: " | + | **NorESM-CAM5_svn{RevisionNumber}_YYMMDD{initials}_Freetext**. \\ |
+ | |||
+ | Example: | ||
+ | "**NorESM-CAM5_svn1094_151201AG_CMIP6endelig**" \\ | ||
Initials AG: Alf Grini, AK: Alf Kirkevåg, DO: Dirk Olivie... | Initials AG: Alf Grini, AK: Alf Kirkevåg, DO: Dirk Olivie... | ||
+ | |||
+ | Where the date YYMMDD corresponds to the time when the AeroCom data preparation script has been executed. | ||
The script creates files named like | The script creates files named like | ||
Line 227: | Line 280: | ||
http:// | http:// | ||
+ | ====== Post analysis and workup of CAM diagnostics output tables ====== | ||
+ | |||
+ | A tool for post analysis of (multiple) CAM diagnostics ASCII tables can be found in | ||
+ | the following repository: | ||
+ | |||
+ | GitHub https:// | ||
+ | |||
+ | To get started, please follow the instructions in repository README (displayed in repository). Currently, the main | ||
+ | analysis tool is a jupyter IPython notebook called | ||
+ | |||
+ | // | ||
+ | |||
+ | which includes more detailed instructions about setup and options. | ||
+ | |||
+ | Use the notebook | ||
+ | |||
+ | https:// | ||
+ | |||
+ | to download local copies of result tables using a list of URL's. | ||
+ | |||
+ | |||
+ | **Short summary: | ||
+ | The notebook reads multiple diagnostics files (runs) into one long table and creates heatmap plots | ||
+ | of //Bias, RMSE and RMSE relative error// for a subset of variables (rows -> y-axis of heatmap) | ||
+ | vs. the individual runs (columns -> xaxis). | ||
+ | |||
+ | **NOTE:** In the current version, you need to download all tables that you are interested in as csv or | ||
+ | ascii into one directory, that is specified in the header of the notebook. | ||
+ | |||
+ | Variable groups can be defined in this config file: | ||
+ | |||
+ | https:// | ||
+ | |||
+ | **NOTE:** If you add groups to this file in your local copy of the repository, please consider sending | ||
+ | the updated to [[mailto: | ||
+ | remains up to date. | ||
+ | |||
+ | **Troubleshooting** | ||
+ | |||
+ | If you run into problems, please raise an issue in the repository or contact [[mailto: | ||