@@ -23,10 +23,8 @@ keypoints:
2323The `` config-user.yml `` configuration file contains all the global level
2424information needed by ESMValTool to run.
2525This is a [ YAML file] ( https://yaml.org/spec/1.2/spec.html ) .
26- An example configuration file can be found in the ESMValCore repository:
27- [ config-user-example.yml] ( https://github.com/ESMValGroup/ESMValCore/blob/master/esmvalcore/config-user.yml ) .
2826
29- You can generate the default configuration file by running:
27+ You can get the default configuration file by running:
3028
3129~~~ bash
3230 esmvaltool config get_config_user
@@ -37,7 +35,8 @@ path to your home directory. Note that files and directories starting with a
3735period are "hidden", to see the ` .esmvaltool ` directory in the terminal use
3836` ls -la ~ ` .
3937
40- We run a text editor called `` nano `` to have a look inside the configuration file:
38+ We run a text editor called `` nano `` to have a look inside the configuration file
39+ and then modify it if needed:
4140
4241~~~ bash
4342 nano ~ /.esmvaltool/config-user.yml
@@ -66,43 +65,14 @@ This file contains the information for:
6665
6766These settings are used to inform ESMValTool about your preference about
6867specific actions. You can turn on or off the setting by `` true `` or `` false ``
69- values. Most of these settings are fairly self-explanatory, ie:
70-
71- ``` yaml
72- # Diagnostics create plots? [true]/false
73- write_plots : true
74- # Diagnositcs write NetCDF files? [true]/false
75- write_netcdf : true
76- # Set the console log level debug, [info], warning, error
77- log_level : info
78- # Exit on warning (only for NCL diagnostic scripts)? true/[false]
79- exit_on_warning : false
80- # Plot file format? [png]/pdf/ps/eps/epsi
81- output_file_type : png
82-
83- ...
84-
85- # Use netCDF compression true/[false]
86- compress_netcdf : false
87- # Save intermediary cubes in the preprocessor true/[false]
88- save_intermediary_cubes : false
89- # Remove the preproc dir if all fine
90- remove_preproc_dir : true
91-
92- ...
93-
94- # Path to custom config-developer file, to customise project configurations.
95- # See config-developer.yml for an example. Set to [null] to use the default
96- config_developer_file : null
97- # Get profiling information for diagnostics
98- # Only available for Python diagnostics
99- profile_diagnostic : false
100- ` ` `
68+ values. Most of these settings are fairly self-explanatory.
69+ For example, ` write_plots: true ` means that diagnostics create plots.
10170
10271> ## Saving preprocessed data
10372>
104- > In the configuration file, which settings are useful to make sure preprocessed
105- > data is stored when ESMValTool is run?
73+ > Later in this tutorial, we will want to look at the contents of the ` preproc ` folder.
74+ > This folder contains preprocessed data and is removed by default when ESMValTool is run.
75+ > In the configuration file, which settings can be modified to prevent this from happening?
10676>
10777>> ## Solution
10878>>
@@ -143,7 +113,8 @@ are not plots, e.g. files in NetCDF format (depends on the diagnostic script).
143113> ## Set the destination directory
144114>
145115> Let's name our destination directory `` esmvaltool_output `` in the working directory.
146- > How to tell ESMValTool about our destination directory?
116+ > ESMValTool should write the output to this path.
117+ > How to modify the ` config-user.yml ` ?
147118>
148119>> ## Solution
149120>>
@@ -156,39 +127,6 @@ are not plots, e.g. files in NetCDF format (depends on the diagnostic script).
156127> {: .solution}
157128{: .challenge}
158129
159- # # Auxiliary data directory
160-
161- The ``auxiliary_data_dir`` setting is the path where any required additional
162- auxiliary data files are stored. This location allows us to tell the diagnostic
163- script where to find the files if they can not be downloaded at runtime. This
164- option should not be used for model or observational datasets, but for data
165- files (e.g. shape files) used in plotting such as coastline descriptions and so
166- on.
167-
168- ` ` ` yaml
169- auxiliary_data_dir: ~/auxiliary_data
170- ` ` `
171-
172- # # Number of parallel tasks
173-
174- This option enables you to perform parallel processing.
175- You can choose the number of tasks in parallel as
176- 1/2/3/4/... or you can set it to ``null``. That tells
177- ESMValTool to use the maximum number of available CPUs :
178-
179- ` ` ` yaml
180- max_parallel_tasks: null
181- ` ` `
182-
183- > # # Set the number of tasks
184- >
185- > If you run out of memory, try setting ``max_parallel_tasks`` to 1.
186- Then, check the amount of memory you need for that by inspecting
187- the file ``run/resource_usage.txt`` in the output directory.
188- Using the number there you can increase the number of parallel tasks
189- again to a reasonable number for the amount of memory available in your system.
190- {: .callout}
191-
192130# # Rootpath to input data
193131
194132ESMValTool uses several categories (in ESMValTool, this is referred to as projects)
@@ -218,7 +156,8 @@ example configuration file.
218156> In this tutorial, we will work with data from
219157> [CMIP5](https://esgf-node.llnl.gov/projects/cmip5/)
220158> and [obs4mips](https://esgf-node.llnl.gov/projects/obs4mips/).
221- > How does ESMValTool find the data?
159+ > How can we moodify the `rootpath` to make sure the data path is set correctly
160+ > for both CMIP5 and obs4mips.
222161>
223162> Note:
224163> to get the data, check instruction in
@@ -276,7 +215,7 @@ information about ``drs``, you can visit the ESMValTool documentation on
276215> In this lesson, we will work with data from
277216> [CMIP5](https://esgf-node.llnl.gov/projects/cmip5/)
278217> and [obs4mips](https://esgf-node.llnl.gov/projects/obs4mips/).
279- > How does ESMValTool know the data structure ?
218+ > How can we set the correct `drs` ?
280219>
281220>> # # Solution
282221>>
@@ -330,6 +269,42 @@ information about ``drs``, you can visit the ESMValTool documentation on
330269> {: .solution}
331270{: .challenge}
332271
272+ # # Other settings
273+
274+ > # # Auxiliary data directory
275+ >
276+ > The ``auxiliary_data_dir`` setting is the path where any required additional
277+ auxiliary data files are stored. This location allows us to tell the diagnostic
278+ script where to find the files if they can not be downloaded at runtime. This
279+ option should not be used for model or observational datasets, but for data
280+ files (e.g. shape files) used in plotting such as coastline descriptions and
281+ if you want to feed some additional data (e.g. shape files) to your recipe.
282+ >
283+ >```yaml
284+ > auxiliary_data_dir: ~/auxiliary_data
285+ > ```
286+ > See more information in ESMValTool
287+ [document](https://docs.esmvaltool.org/projects/ESMValCore/en/latest/quickstart/configure.html?highlight=auxiliary_data#user-configuration-file).
288+ {: .callout}
289+
290+ > # # Number of parallel tasks
291+ >
292+ > This option enables you to perform parallel processing.
293+ You can choose the number of tasks in parallel as
294+ 1/2/3/4/... or you can set it to ``null``. That tells
295+ ESMValTool to use the maximum number of available CPUs :
296+ >
297+ >```yaml
298+ > max_parallel_tasks: null
299+ > ```
300+ >
301+ > If you run out of memory, try setting ``max_parallel_tasks`` to 1.
302+ Then, check the amount of memory you need for that by inspecting
303+ the file ``run/resource_usage.txt`` in the output directory.
304+ Using the number there you can increase the number of parallel tasks
305+ again to a reasonable number for the amount of memory available in your system.
306+ {: .callout}
307+
333308> # # Make your own configuration file
334309>
335310> It is possible to have several configuration files with different purposes,
0 commit comments