Skip to content

Commit 5be74d5

Browse files
committed
small updates
1 parent 1a14aba commit 5be74d5

File tree

1 file changed

+35
-23
lines changed

1 file changed

+35
-23
lines changed

_episodes/09-cmorization.md

Lines changed: 35 additions & 23 deletions
Original file line numberDiff line numberDiff line change
@@ -147,38 +147,44 @@ name that was created to store the raw observation data files, i.e.
147147
If everything is okay, the output should look something like this:
148148
149149
~~~
150-
...
151-
... Starting the CMORization Tool at time: 2022-07-26 14:02:16 UTC
150+
... Writing program log files to:
151+
/scratch/b/b309059/esmvaltool_output/data_formatting_20240527_132448/run/main_log.txt
152+
/scratch/b/b309059/esmvaltool_output/data_formatting_20240527_132448/run/main_log_debug.txt
153+
... Starting the CMORization Tool at time: 2024-05-27 13:24:48 UTC
152154
... ----------------------------------------------------------------------
153-
... input_dir = /home/peter/data/RAWOBS
154-
... output_dir = /home/peter/esmvaltool_output/data_formatting_20220726_140216
155+
... input_dir = /work/bd0854/DATA/ESMValTool2/RAWOBS
156+
... output_dir = /scratch/b/b309059/esmvaltool_output/data_formatting_20240527_132448
155157
... ----------------------------------------------------------------------
156158
... Running the CMORization scripts.
157159
... Processing datasets ['FLUXCOM']
158-
... Input data from: /home/peter/data/RAWOBS/Tier3/FLUXCOM
159-
... Output will be written to: /home/peter/esmvaltool_output/
160-
data_formatting_20220726_140216/Tier3/FLUXCOM
161-
... Reformat script: /home/peter/mambaforge/envs/esmvaltool/lib/python3.9/
162-
site-packages/esmvaltool/cmorizers/data/formatters/datasets/fluxcom
163-
... CMORizing dataset FLUXCOM using Python script /home/peter/mambaforge/envs/
164-
esmvaltool/lib/python3.9/site-packages/esmvaltool/cmorizers/data/formatters/
165-
datasets/fluxcom.py
166-
... Found input file '/home/peter/data/RAWOBS/Tier3/FLUXCOM/GPP.ANN.CRUNCEPv6.monthly.*.nc'
160+
... Input data from: /work/bd0854/DATA/ESMValTool2/RAWOBS/Tier3/FLUXCOM
161+
... Output will be written to: /scratch/b/b309059/esmvaltool_output/data_formatting_20240527_132448/Tier3/FLUXCOM
162+
... Reformat script: /home/b/b309059/ESMValTool/ESMValTool/esmvaltool/cmorizers/data/formatters/datasets/fluxcom
163+
... CMORizing dataset FLUXCOM using Python script /home/b/b309059/ESMValTool/ESMValTool/esmvaltool/cmorizers/data/formatters/datasets/fluxcom.py
164+
... Found input file '/work/bd0854/DATA/ESMValTool2/RAWOBS/Tier3/FLUXCOM/GPP.ANN.CRUNCEPv6.monthly.*.nc'
167165
... CMORizing variable 'gpp'
168166
... Lmon
169167
... Var is gpp
170-
... ... UserWarning: Ignoring netCDF variable 'GPP' invalid units 'gC m-2 day-1'
168+
... WARNING /work/bd0854/b309059/utils/mambaforge/envs/esmvaltool/lib/python3.11/site-packages/iris/fileformats/_nc_load_rules/helpers.py:913: _WarnComboIgnoringCfLoad: Ignoring invalid u
169+
nits 'gC m-2 day-1' on netCDF variable 'GPP'.
170+
warnings.warn(
171171
172172
... Fixing time...
173173
... Fixing latitude...
174174
... Fixing longitude...
175175
... Flipping dimensional coordinate latitude...
176176
... Saving file
177-
... Saving: /home/peter/esmvaltool_output/data_formatting_20220726_140216/Tier3/
178-
FLUXCOM/OBS_FLUXCOM_reanaly_ANN-v1_Lmon_gpp_200001-200012.nc
177+
... Saving: /scratch/b/b309059/esmvaltool_output/data_formatting_20240527_132448/Tier3/FLUXCOM/OBS_FLUXCOM_reanaly_ANN-v1_Lmon_gpp_198001-198012.nc
179178
... Cube has lazy data [lazy is preferred]
179+
... WARNING /work/bd0854/b309059/utils/mambaforge/envs/esmvaltool/lib/python3.11/site-packages/iris/fileformats/netcdf/saver.py:2670: IrisDeprecation: Saving to netcdf with legacy-style a
180+
ttribute handling for backwards compatibility.
181+
This mode is deprecated since Iris 3.8, and will eventually be removed.
182+
Please consider enabling the new split-attributes handling mode, by setting 'iris.FUTURE.save_split_attrs = True'.
183+
warn_deprecated(message)
184+
180185
... CMORization of dataset FLUXCOM finished!
181186
... Formatting successful for dataset FLUXCOM
187+
182188
~~~
183189
{: .output}
184190
@@ -629,17 +635,23 @@ If we now run the test recipe on our newly 'CMORized' data,
629635
esmvaltool run recipe_check_fluxcom.yml --config_file <path to config-user.yml> --log_level debug
630636
```
631637

632-
it should be able to find the correct file, but it does not succeed yet. The first
633-
thing that the ESMValTool CMOR checker brings up is:
638+
it should be able to find the correct file, but it does not succeed yet. The ESMValTool CMOR checker
639+
brings up is:
634640

635641
~~~
636-
iris.exceptions.UnitConversionError: Cannot convert from unknown units. The
637-
"units" attribute may be set directly.
642+
esmvalcore.cmor.check.CMORCheckError: There were errors in variable GPP:
643+
GPP: units should be kg m-2 s-1, not unknown
644+
lon: standard_name should be longitude, not None
645+
lat: standard_name should be latitude, not None
646+
lon: units should be degrees_east, not unknown
647+
lon: has values < valid_min = 0.0
648+
lat: units should be degrees_north, not unknown
649+
GPP: does not match coordinate rank
638650
~~~
639651
{: .error}
640652

641-
If you look closely at the error messages, you can see that this error concerns
642-
the units of the coordinates. ESMValTool tries to fix them automatically,
653+
If you look closely at the error messages, you can see that these error concern
654+
e.g. the units of the coordinates. ESMValTool tries to fix them automatically,
643655
but since no units are defined on the coordinates, this fails.
644656

645657
The cmorizer utilities also include a function called `fix_coords`, but before
@@ -696,7 +708,7 @@ The next error is:
696708

697709
~~~
698710
esmvalcore.cmor.check.CMORCheckError: There were errors in variable GPP:
699-
Variable GPP units unknown can not be converted to kg m-2 s-1 in cube:
711+
GPP: units should be kg m-2 s-1, not unknown
700712
~~~
701713
{: .error}
702714

0 commit comments

Comments
 (0)