You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: _episodes/03-configuration.md
+16-4Lines changed: 16 additions & 4 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -28,7 +28,7 @@ Let's change our working directory to ESMValTool, then make a copy of the file a
28
28
This file contains the information for:
29
29
* Rootpath to input data
30
30
* Directory structure for the data from different projects
31
-
* Number of available CPUs
31
+
* Number of parallel tasks
32
32
* Destination directory
33
33
* Auxiliary data directory
34
34
* Output settings
@@ -69,7 +69,7 @@ Add the root path of the folder where you downloaded the data during the [Setup]
69
69
70
70
> ## Setting the correct rootpath
71
71
>
72
-
> *For more information about setting the rootpath, you can visit ESMValTool [documentation](https://esmvaltool.readthedocs.io/projects/esmvalcore/en/latest/esmvalcore/datafinder.html).
72
+
> For more information about setting the rootpath, you can visit ESMValTool [documentation](https://esmvaltool.readthedocs.io/projects/esmvalcore/en/latest/esmvalcore/datafinder.html).
73
73
{: .callout}
74
74
75
75
## Directory structure for the data from different projects
@@ -83,10 +83,22 @@ drs:
83
83
84
84
> ## Available drs
85
85
>
86
-
> * For more information about directories, you can visit ESMValTool [documentation](https://esmvaltool.readthedocs.io/projects/esmvalcore/en/latest/esmvalcore/config.html#developer-configuration-file).
86
+
> For more information about directories, you can visit ESMValTool [documentation](https://esmvaltool.readthedocs.io/projects/esmvalcore/en/latest/esmvalcore/config.html#developer-configuration-file).
87
+
{: .callout}
88
+
89
+
## Number of parallel tasks
90
+
This option enables you to perform parallel processing. You can choose the number of tasks in parallel as 1/2/3/4/... or you can set it to ``null`` that tells ESMValTool to use the number of available CPUs:
91
+
92
+
~~~
93
+
max_parallel_tasks: null
94
+
~~~
95
+
{: .source}
96
+
97
+
> ## Set the number of tasks
98
+
>
99
+
> If you run out of memory, try setting ``max_parallel_tasks`` to 1. Then, check the amount of memory you need for that by inspecting the file ``run/resource_usage.txt`` in the output directory. Using the number there you can increase the number of parallel tasks again to a reasonable number for the amount of memory available in your system.
87
100
{: .callout}
88
101
89
-
## Number of available CPUs
90
102
## Auxiliary data directory (used for some additional datasets)
0 commit comments