Investigation: How to add a bespoke project to ESMValTool
-
Does the radiation budget recipe complete without errors if the project in a copy of the radiation budget recipe is updated to an arbitrary name, e.g. CMEW?
No, the radiation budget recipe does not complete without errors, and shows the error - Unable to load CMOR tables for the project 'CMEW' and all the variables.
-
Does the arbitrary name need a corresponding entry in the rootpath and drs sections in the ESMValTool user configuration file?
Yes the name requires entry in the rootpath and drs sections as every project has a rootpath which refers to the input data source and drs sets the directory structure the root paths are structured by. Since, the dataset was given the project name CMEW it needs to point to a data source for it. For this purpose, I used the netcdf files which were produced by running the radiation budget recipe, and stored it in the path /data/users/aram/cylc- run/climate-model-evaluation-workflow/.. All the rootpath and drs is specified in the config-user.yml file, which was updated to show rootpath CMEW: /data/users/aram/cylc-run/climate-model-evaluation-workflow/ and drs - default. Also, the developer file was updated with a project entry for CMEW. After running the recipe with these changes, the output was the same as the point above - Unable to load CMOR tables for the project 'CMEW' and all the variables.
-
Does the radiation budget recipe complete without errors if the dataset in a copy of the radiation budget recipe is updated to a model run ID, e.g. u-ab123?
The radiation budget recipe still has errors once the dataset is changed to u-ab123. I changed each input files which contained HadGEM3-GC31-LL as the dataset to u-ab123 using iris.save, and changed the model run id in the config-user file to it, and ran the recipe. The output was the same as the point above.
-
Does the radiation budget recipe complete without errors if the ensemble is also updated?
I updated the ensemble to r1i1p1f1 in the config-user.yml, and changed each input file's ensemble to it as well. Then I ran the recipe, and the radiation budget still shows the same error as above.
-
If this doesn't work, what would be needed to get this to work? For example, is there a pre-defined list of project hard-coded in ESMValTool? If so, can this list be updated at run time?
It is unclear what would get this to work. I haven't been able to find any pre-defined list of projects hardcoded in ESMValTool besides, the config- developer.yml file. It cannot be updated during run time.
-
Is there any ESMValTool documentation that describes adding a new project?
There is not much information in the documentation that specifically describes adding a new project, however, the ESMValTool config-developer.yml file contains the the project and machine-dependent directory and input and output data files.