unit testing?

[edwardhartnett]

Is there any unit testing code for ccpp-framework?

For example, when installing ccpp-framework on an operational system, is there a suite of tests I can run to ensure it's working?

[peverwhee]

hi @edwardhartnett

There are Fortran system tests as well as python unit tests that can be run here (I assume you're using prebuild):
$ccpp-framework/test_prebuild/run_all_tests.sh
You can also run the prebuild tests via pytest. You can follow the workflow here: $ccpp-framework/.github/workflows/prebuild.yaml

If you are instead trying to test capgen (the newer version of ccpp-framework that @dustinswales has been working on integrating), testing is here:
$ccpp-framework/test
and the workflow is $ccpp-framework/.github/workflows/capgen-unit-tests.yaml

[climbfuji]

You are using ccpp-prebuild

[climbfuji]

And no, there is no cmake target like make test

[climbfuji]

Note that you cannot really "install+run" ccpp without a host model. There is an interdependency here that cannot be broken, that's why the tests all set up some sort of stub/fake host model that the CCPP framework and (stub) physics can interact with.

[edwardhartnett]

I actually don't need install+run, I need install+test. Many libraries can do install+test but not install+run.

Stubs are fine, if they result in testing of ccpp code in the way the code is used operationally. (That is, make stubs sufficiently like the real thing to be effective.)

The question is, can spack run some tests after installing ccpp (and whatever dependent packages ccpp requires), but before the rest of the UFS is installed?

If there is such a way, and it sounds like there is, wouldn't that be the basis for "make test"?

[climbfuji]

Probably. But I am not positive that there are resources available internally to implement this. If someone wanted to contribute this, then my recommendation would be to focus on capgen, since prebuild will be removed within the next year or so.