Skip to content

Commit 48febe6

Browse files
committed
revise the text
1 parent c556592 commit 48febe6

File tree

1 file changed

+49
-74
lines changed

1 file changed

+49
-74
lines changed

_episodes/03-configuration.md

Lines changed: 49 additions & 74 deletions
Original file line numberDiff line numberDiff line change
@@ -23,10 +23,8 @@ keypoints:
2323
The ``config-user.yml`` configuration file contains all the global level
2424
information needed by ESMValTool to run.
2525
This is a [YAML file](https://yaml.org/spec/1.2/spec.html).
26-
An example configuration file can be found in the ESMValCore repository:
27-
[config-user-example.yml](https://github.com/ESMValGroup/ESMValCore/blob/master/esmvalcore/config-user.yml).
2826

29-
You can generate the default configuration file by running:
27+
You can get the default configuration file by running:
3028

3129
~~~bash
3230
esmvaltool config get_config_user
@@ -37,7 +35,8 @@ path to your home directory. Note that files and directories starting with a
3735
period are "hidden", to see the `.esmvaltool` directory in the terminal use
3836
`ls -la ~`.
3937

40-
We run a text editor called ``nano`` to have a look inside the configuration file:
38+
We run a text editor called ``nano`` to have a look inside the configuration file
39+
and then modify it if needed:
4140

4241
~~~bash
4342
nano ~/.esmvaltool/config-user.yml
@@ -66,43 +65,14 @@ This file contains the information for:
6665

6766
These settings are used to inform ESMValTool about your preference about
6867
specific actions. You can turn on or off the setting by ``true`` or ``false``
69-
values. Most of these settings are fairly self-explanatory, ie:
70-
71-
```yaml
72-
# Diagnostics create plots? [true]/false
73-
write_plots: true
74-
# Diagnositcs write NetCDF files? [true]/false
75-
write_netcdf: true
76-
# Set the console log level debug, [info], warning, error
77-
log_level: info
78-
# Exit on warning (only for NCL diagnostic scripts)? true/[false]
79-
exit_on_warning: false
80-
# Plot file format? [png]/pdf/ps/eps/epsi
81-
output_file_type: png
82-
83-
...
84-
85-
# Use netCDF compression true/[false]
86-
compress_netcdf: false
87-
# Save intermediary cubes in the preprocessor true/[false]
88-
save_intermediary_cubes: false
89-
# Remove the preproc dir if all fine
90-
remove_preproc_dir: true
91-
92-
...
93-
94-
# Path to custom config-developer file, to customise project configurations.
95-
# See config-developer.yml for an example. Set to [null] to use the default
96-
config_developer_file: null
97-
# Get profiling information for diagnostics
98-
# Only available for Python diagnostics
99-
profile_diagnostic: false
100-
```
68+
values. Most of these settings are fairly self-explanatory.
69+
For example, `write_plots: true` means that diagnostics create plots.
10170

10271
> ## Saving preprocessed data
10372
>
104-
> In the configuration file, which settings are useful to make sure preprocessed
105-
> data is stored when ESMValTool is run?
73+
> Later in this tutorial, we will want to look at the contents of the `preproc` folder.
74+
> This folder contains preprocessed data and is removed by default when ESMValTool is run.
75+
> In the configuration file, which settings can be modified to prevent this from happening?
10676
>
10777
>> ## Solution
10878
>>
@@ -143,7 +113,8 @@ are not plots, e.g. files in NetCDF format (depends on the diagnostic script).
143113
> ## Set the destination directory
144114
>
145115
> Let's name our destination directory ``esmvaltool_output`` in the working directory.
146-
> How to tell ESMValTool about our destination directory?
116+
> ESMValTool should write the output to this path.
117+
> How to modify the `config-user.yml`?
147118
>
148119
>> ## Solution
149120
>>
@@ -156,39 +127,6 @@ are not plots, e.g. files in NetCDF format (depends on the diagnostic script).
156127
> {: .solution}
157128
{: .challenge}
158129
159-
## Auxiliary data directory
160-
161-
The ``auxiliary_data_dir`` setting is the path where any required additional
162-
auxiliary data files are stored. This location allows us to tell the diagnostic
163-
script where to find the files if they can not be downloaded at runtime. This
164-
option should not be used for model or observational datasets, but for data
165-
files (e.g. shape files) used in plotting such as coastline descriptions and so
166-
on.
167-
168-
```yaml
169-
auxiliary_data_dir: ~/auxiliary_data
170-
```
171-
172-
## Number of parallel tasks
173-
174-
This option enables you to perform parallel processing.
175-
You can choose the number of tasks in parallel as
176-
1/2/3/4/... or you can set it to ``null``. That tells
177-
ESMValTool to use the maximum number of available CPUs:
178-
179-
```yaml
180-
max_parallel_tasks: null
181-
```
182-
183-
> ## Set the number of tasks
184-
>
185-
> If you run out of memory, try setting ``max_parallel_tasks`` to 1.
186-
Then, check the amount of memory you need for that by inspecting
187-
the file ``run/resource_usage.txt`` in the output directory.
188-
Using the number there you can increase the number of parallel tasks
189-
again to a reasonable number for the amount of memory available in your system.
190-
{: .callout}
191-
192130
## Rootpath to input data
193131
194132
ESMValTool uses several categories (in ESMValTool, this is referred to as projects)
@@ -218,7 +156,8 @@ example configuration file.
218156
> In this tutorial, we will work with data from
219157
> [CMIP5](https://esgf-node.llnl.gov/projects/cmip5/)
220158
> and [obs4mips](https://esgf-node.llnl.gov/projects/obs4mips/).
221-
> How does ESMValTool find the data?
159+
> How can we moodify the `rootpath` to make sure the data path is set correctly
160+
> for both CMIP5 and obs4mips.
222161
>
223162
> Note:
224163
> to get the data, check instruction in
@@ -276,7 +215,7 @@ information about ``drs``, you can visit the ESMValTool documentation on
276215
> In this lesson, we will work with data from
277216
> [CMIP5](https://esgf-node.llnl.gov/projects/cmip5/)
278217
> and [obs4mips](https://esgf-node.llnl.gov/projects/obs4mips/).
279-
> How does ESMValTool know the data structure?
218+
> How can we set the correct `drs`?
280219
>
281220
>> ## Solution
282221
>>
@@ -330,6 +269,42 @@ information about ``drs``, you can visit the ESMValTool documentation on
330269
> {: .solution}
331270
{: .challenge}
332271
272+
## Other settings
273+
274+
> ## Auxiliary data directory
275+
>
276+
> The ``auxiliary_data_dir`` setting is the path where any required additional
277+
auxiliary data files are stored. This location allows us to tell the diagnostic
278+
script where to find the files if they can not be downloaded at runtime. This
279+
option should not be used for model or observational datasets, but for data
280+
files (e.g. shape files) used in plotting such as coastline descriptions and
281+
if you want to feed some additional data (e.g. shape files) to your recipe.
282+
>
283+
>```yaml
284+
> auxiliary_data_dir: ~/auxiliary_data
285+
> ```
286+
> See more information in ESMValTool
287+
[document](https://docs.esmvaltool.org/projects/ESMValCore/en/latest/quickstart/configure.html?highlight=auxiliary_data#user-configuration-file).
288+
{: .callout}
289+
290+
> ## Number of parallel tasks
291+
>
292+
> This option enables you to perform parallel processing.
293+
You can choose the number of tasks in parallel as
294+
1/2/3/4/... or you can set it to ``null``. That tells
295+
ESMValTool to use the maximum number of available CPUs:
296+
>
297+
>```yaml
298+
> max_parallel_tasks: null
299+
> ```
300+
>
301+
> If you run out of memory, try setting ``max_parallel_tasks`` to 1.
302+
Then, check the amount of memory you need for that by inspecting
303+
the file ``run/resource_usage.txt`` in the output directory.
304+
Using the number there you can increase the number of parallel tasks
305+
again to a reasonable number for the amount of memory available in your system.
306+
{: .callout}
307+
333308
> ## Make your own configuration file
334309
>
335310
> It is possible to have several configuration files with different purposes,

0 commit comments

Comments
 (0)