Differences
This shows you the differences between two versions of the page.
Both sides previous revision Previous revision Next revision | Previous revision Next revision Both sides next revision | ||
noresm:modeldiagnostics [2017-11-23 20:15:53] johan.liakka@nersc.no [NorESM Diagnostic Packages] |
noresm:modeldiagnostics [2020-12-22 12:44:09] yanchun.he@nersc.no [NorESM Diagnostic Packages] |
||
---|---|---|---|
Line 1: | Line 1: | ||
====== Model Diagnostic Tools====== | ====== Model Diagnostic Tools====== | ||
- | This page links to tools used for NorESM model evaluation. | + | This page links to tools used for the NorESM model evaluation. |
===== NorESM Diagnostic Packages ===== | ===== NorESM Diagnostic Packages ===== | ||
+ | |||
+ | Output from the latest NCAR diagnostic pages can be found on nird here: | ||
+ | |||
+ | via the web: | ||
+ | http:// | ||
+ | |||
+ | via the filesystem on nird here: | ||
+ | / | ||
+ | |||
+ | **NB: The following wiki page for the NorESM diagnostic tools is moved!!** | ||
+ | |||
+ | Last updated: 12-Dec-2020. | ||
+ | |||
+ | Please go to the following NorESM documentation page for the latest description: | ||
+ | |||
+ | https:// | ||
+ | ---- | ||
+ | |||
The diagnostics packages are currently available on NIRD. Each package can be run/ | The diagnostics packages are currently available on NIRD. Each package can be run/ | ||
Line 10: | Line 28: | ||
------------------------------------------------- | ------------------------------------------------- | ||
Program: | Program: | ||
- | / | + | / |
- | Version: | + | Version: |
------------------------------------------------- | ------------------------------------------------- | ||
Short description: | Short description: | ||
- | diag_run is used to configure and run the NorESM diagnostic packages. | + | A wrapper script for NorESM diagnostic packages. |
- | + | ||
Basic usage: | Basic usage: | ||
diag_run -m [model] -c [test case name] -s [test case start yr] -e [test case end yr] # Run model-obs diagnostics | diag_run -m [model] -c [test case name] -s [test case start yr] -e [test case end yr] # Run model-obs diagnostics | ||
diag_run -m [model] -c [test case name] -s [test case start yr] -e [test case end yr] -c2 [cntl case name] -s2 [cntl case start yr] -e2 [cntl case end yr] # Run model1-model2 diagnostics | diag_run -m [model] -c [test case name] -s [test case start yr] -e [test case end yr] -c2 [cntl case name] -s2 [cntl case start yr] -e2 [cntl case end yr] # Run model1-model2 diagnostics | ||
- | nohup / | + | nohup / |
- | + | ||
Command-line options: | Command-line options: | ||
-m, --model=MODEL | -m, --model=MODEL | ||
Valid arguments: | Valid arguments: | ||
- | cam : atmospheric package (AMWG) | + | cam : atmospheric package (AMWG) |
- | clm : land package (LMWG) | + | clm : land package (LMWG) |
- | cice : sea-ice package | + | cice |
- | all : configure all available packages | + | blom : ocean package |
+ | hamocc : biogeochemistry | ||
+ | all : configure all available packages. | ||
-c, -c1, --case=CASE1, | -c, -c1, --case=CASE1, | ||
-s, -s1, --start_yr=SYR1, | -s, -s1, --start_yr=SYR1, | ||
Line 38: | Line 58: | ||
-i2, --input-dir2=DIR | -i2, --input-dir2=DIR | ||
Default is --input-dir=/ | Default is --input-dir=/ | ||
- | -o, --output-dir=DIR | + | -o, --output-dir=DIR |
- | Default is --output-dir=/ | + | Default is --output-dir=/ |
-p, --passive-mode | -p, --passive-mode | ||
-t, --type=TYPE | -t, --type=TYPE | ||
Default is to run both. Note that the time series are computed over the entire simulation. | Default is to run both. Note that the time series are computed over the entire simulation. | ||
-w, --web-dir=DIR | -w, --web-dir=DIR | ||
- | Default is --web-dir=/ | + | Default is --web-dir=/ |
- | + | --no-atm | |
Examples: | Examples: | ||
- | diag_run -m all -c N1850_f19_tn11_exp1 -s 21 -e 50 # model-obs diagnostics of N1850_f19_tn11_exp1 | + | diag_run -m all -c N1850_f19_tn11_exp1 -s 21 -e 50 # model-obs diagnostics of case=N1850_f19_tn11_exp1 (climatology between yrs 21 and 50) for all model components. |
- | diag_run -m cam -c N1850_f19_tn11_exp1 -s 21 -e 50 -w / | + | diag_run -m cam -c N1850_f19_tn11_exp1 -s 21 -e 50 -w / |
+ | diag_run -m blom -c N1850_f19_tn11_exp1 -t time_series # model-obs time-series diagnostics in BLOM for all years represented in the model output directory (/ | ||
diag_run -m cice -c N1850_f19_tn11_exp1 -s 21 -e 50 -p # configure (but do not run) model-obs diagnostics for CICE. | diag_run -m cice -c N1850_f19_tn11_exp1 -s 21 -e 50 -p # configure (but do not run) model-obs diagnostics for CICE. | ||
diag_run -m clm -c N1850_f19_tn11_exp1 -s 21 -e 50 -i / | diag_run -m clm -c N1850_f19_tn11_exp1 -s 21 -e 50 -i / | ||
- | diag_run -m clm -c N1850_f19_tn11_exp1 -s 21 -e 50 -t climo # model-obs climatology diagnostics (no time series) for CLM: | + | diag_run -m blom -c N1850_f19_tn11_exp1 -s 21 -e 50 -t climo # model-obs climatology diagnostics (no time series) for BLOM: |
diag_run -m cam -o /my/dir # install CAM diagnostics in /my/dir with minimal configuration. | diag_run -m cam -o /my/dir # install CAM diagnostics in /my/dir with minimal configuration. | ||
+ | diag_run -m blom,hamocc -c N1850OC_f19_tn11_exp1 -s 21 -e 50 # model-obs diagnostics for BLOM and HAMOCC. | ||
+ | diag_run -m clm -c N1850_f19_tn11_clmexp1 -s 71 -e 100 --no-atm # model-obs time-series diagnostics for an offline (uncoupled) CLM simulation. | ||
+ | diag_run -m hamocc -c N1850OC_f19_tn11_exp1 -s 31 -e 100 -t time_series # model-obs time-series diagnostics in HAMOCC between yrs 31 and 100. | ||
+ | |||
+ | *** NOTE: '-m micom' should be used for the ocean component of NorESM version 1 *** | ||
</ | </ | ||
- | Report any problems, comments or suggestions to Johan Liakka: [[mailto:johan.liakka@nersc.no|johan.liakka@nersc.no]] | + | A comprehensive technical summary of diag_run (pdf): {{ :noresm: |
+ | Report any problems, comments or suggestions to Yanchun He: [[mailto: | ||
- | ===== MICOM Diagnostic Package ===== | + | === Recent updates |
+ | * 08.08.19. Note: NS2345K is recovered now, please use the normal / | ||
+ | * 08.08.19. Update to v6.0: add support to TS-derived mlts, global averages: tempga, | ||
+ | * 29.08.18. Update to v5.1: update NCO/NCL versions to support efficient process of compressed netcdf-4 files. | ||
+ | * 29.06.18. Update to v5.0: new fields to HAMOCC and MICOM diagnostics; | ||
+ | * 20.04.18. Update to v4.3: added new fields to HAMOCC diagnostics. | ||
+ | * 19.04.18. Update to v4.2: included ability to do time-series diagnostics between two user-specified years. | ||
+ | * 18.04.18. Update to v4.1: improved climatology and time-series calculations in CLM, and introduction of the --no-atm option to enable diagnostics for offline CLM simulations. | ||
+ | * 09.04.18. Update to v4.0: included the HAMOCC diagnostics package. | ||
+ | * 23.02.18. Update to v3.1: added monthly MLD, seasonal SST/SSS and annual meridional heat/ | ||
+ | * 17.01.18. Update to v3.0: the first version of MICOM diagnostics has been included. | ||
+ | * 28.11.17. Update to v2.0: included a set of time series plots in CAM diagnostics, | ||
- | (NEW 2015.04.23) | + | ===Using diag_run with cron=== |
- | First version of MICOM diagnostic package is available on grunch/norstore/ | + | If you want to use diag_run with crontab, you first need to load $HOME/.bash_profile, |
- | + | < | |
- | ===== SVN Repository for NorESM Diagnostic Packages | + | # |
- | + | # Min Hour Day Month Weekday Command(s) | |
- | (NEW 2015.04.23) | + | # |
- | + | 50 09 23 11 * . $HOME/ | |
- | The NorESM Diagnostic Packages can be downloaded via svn using the command: | + | /projects/ |
- | svn export svn://noresg.norstore.no/NoresmDiagnosticPackages | + | </file> |
+ | === Other tips === | ||
+ | It is useful to add diag_run as an alias in $HOME/ | ||
+ | < | ||
+ | alias diag_run='/ | ||
+ | </ | ||
- | A web-viewer is available at [[https:// | ||
+ | === NorESM diagnostics on GitHub === | ||
+ | The NorESM diagnostics packages and diag_run are included in the Git version control repository: | ||
+ | [[https:// | ||
====== Aerosol and Chemistry, Clouds and Forcing Diagnostics ====== | ====== Aerosol and Chemistry, Clouds and Forcing Diagnostics ====== | ||
Line 246: | Line 292: | ||
http:// | http:// | ||
+ | ====== Post analysis and workup of CAM diagnostics output tables ====== | ||
+ | |||
+ | A tool for post analysis of (multiple) CAM diagnostics ASCII tables can be found in | ||
+ | the following repository: | ||
+ | |||
+ | GitHub https:// | ||
+ | |||
+ | To get started, please follow the instructions in repository README (displayed in repository). Currently, the main | ||
+ | analysis tool is a jupyter IPython notebook called | ||
+ | |||
+ | // | ||
+ | |||
+ | which includes more detailed instructions about setup and options. | ||
+ | |||
+ | Use the notebook | ||
+ | |||
+ | https:// | ||
+ | |||
+ | to download local copies of result tables using a list of URL's. | ||
+ | |||
+ | |||
+ | **Short summary: | ||
+ | The notebook reads multiple diagnostics files (runs) into one long table and creates heatmap plots | ||
+ | of //Bias, RMSE and RMSE relative error// for a subset of variables (rows -> y-axis of heatmap) | ||
+ | vs. the individual runs (columns -> xaxis). | ||
+ | |||
+ | **NOTE:** In the current version, you need to download all tables that you are interested in as csv or | ||
+ | ascii into one directory, that is specified in the header of the notebook. | ||
+ | |||
+ | Variable groups can be defined in this config file: | ||
+ | |||
+ | https:// | ||
+ | |||
+ | **NOTE:** If you add groups to this file in your local copy of the repository, please consider sending | ||
+ | the updated to [[mailto: | ||
+ | remains up to date. | ||
+ | |||
+ | **Troubleshooting** | ||
+ | If you run into problems, please raise an issue in the repository or contact [[mailto: |