Regression Tests

Building cprnc

In order for the regression tests to work, the cprnc tool (which is a truncation of the phrase “compare NetCDF”) must be built.

$ cd /lustre/project/k1421/cesm2_1_relsd_m5.6/cime/tools/cprnc
$ CIMEROOT=../.. ../configure --macros-format=Makefile --mpilib=mpi-serial
$ CIMEROOT=../.. source ./.env_mach_specific.sh && make

Edit config_machines.xml

Now we set the path to cprnc within config_machines.xml:

$ cd /lustre/project/k1421/CESM/cime/config/cesm/machines
$ vim config_machines.xml
<CCSM_CPRNC>/lustre/project/k1421/CESM/cime/tools/cprnc</CCSM_CPRNC>

Run the tests

$ cd /lustre/project/k1421/CESM/cime/scripts/tests
$ ./scripts_regression_tests.py

It is unclear what constitutes a good result in a regression test. In this post by Zoe Gillett on the DiscussCESM bulletin boards a lot of the regression tests fail and Jim Edwards responds that, “If you are satisfied with the integrity of the experiments you want to run I think you can call this a good result.”