Skip to content

Commit a2878f8

Browse files
committed
Move list of dataset urls to text file
1 parent 4668e8e commit a2878f8

File tree

2 files changed

+27
-35
lines changed

2 files changed

+27
-35
lines changed

data/dataset.urls

Lines changed: 23 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1,10 +1,33 @@
11
# Dataset urls required fo tutorial, described at https://esmvalgroup.github.io/ESMValTool_Tutorial/setup.html#using-your-own-machine
2+
# For Running a recipe episode
3+
# Variable = thetaoga, model = HadGEM2-ES
24
http://esgf-data1.ceda.ac.uk/thredds/fileServer/esg_dataroot/cmip5/output1/MOHC/HadGEM2-ES/historical/mon/ocean/Omon/r1i1p1/v20110916/thetaoga/thetaoga_Omon_HadGEM2-ES_historical_r1i1p1_185912-200512.nc
5+
# Variable = ts, model = HadGEM2-ES
36
http://esgf-data1.ceda.ac.uk/thredds/fileServer/esg_dataroot/cmip5/output1/MOHC/HadGEM2-ES/historical/mon/atmos/Amon/r1i1p1/v20120928/ts/ts_Amon_HadGEM2-ES_historical_r1i1p1_188412-190911.nc
47
http://esgf-data1.ceda.ac.uk/thredds/fileServer/esg_dataroot/cmip5/output1/MOHC/HadGEM2-ES/historical/mon/atmos/Amon/r1i1p1/v20120928/ts/ts_Amon_HadGEM2-ES_historical_r1i1p1_190912-193411.nc
58
http://esgf-data1.ceda.ac.uk/thredds/fileServer/esg_dataroot/cmip5/output1/MOHC/HadGEM2-ES/historical/mon/atmos/Amon/r1i1p1/v20120928/ts/ts_Amon_HadGEM2-ES_historical_r1i1p1_195912-198411.nc
69
http://esgf-data1.ceda.ac.uk/thredds/fileServer/esg_dataroot/cmip5/output1/MOHC/HadGEM2-ES/historical/mon/atmos/Amon/r1i1p1/v20120928/ts/ts_Amon_HadGEM2-ES_historical_r1i1p1_198412-200511.nc
10+
# Variable = tas, model = HadGEM2-AO
11+
# TODO add links
12+
# Variable = tas, model = HadGEM2-ES
713
http://esgf-data1.ceda.ac.uk/thredds/fileServer/esg_dataroot/cmip5/output1/MOHC/HadGEM2-ES/historical/mon/atmos/Amon/r1i1p1/v20120928/tas/tas_Amon_HadGEM2-ES_historical_r1i1p1_188412-190911.nc
814
http://esgf-data1.ceda.ac.uk/thredds/fileServer/esg_dataroot/cmip5/output1/MOHC/HadGEM2-ES/historical/mon/atmos/Amon/r1i1p1/v20120928/tas/tas_Amon_HadGEM2-ES_historical_r1i1p1_190912-193411.nc
915
http://esgf-data1.ceda.ac.uk/thredds/fileServer/esg_dataroot/cmip5/output1/MOHC/HadGEM2-ES/historical/mon/atmos/Amon/r1i1p1/v20120928/tas/tas_Amon_HadGEM2-ES_historical_r1i1p1_195912-198411.nc
1016
http://esgf-data1.ceda.ac.uk/thredds/fileServer/esg_dataroot/cmip5/output1/MOHC/HadGEM2-ES/historical/mon/atmos/Amon/r1i1p1/v20120928/tas/tas_Amon_HadGEM2-ES_historical_r1i1p1_198412-200511.nc
17+
# Variable = tos, model = HadGEM2-AO
18+
# TODO add links
19+
# Variable = tos, model = HadGEM2-CC
20+
# TODO add links
21+
# Variable = tos, model = HadGEM2-ES
22+
# TODO add links
23+
# For Working with preprocessors episode
24+
# Model = UKESM1-0-LL, project = CMIP6, Experiment = historical, ensemble= r1i1p1f2, variable = pr and tas
25+
# TODO add links
26+
# Model = CanESM2, ensemble: "r(1:4)i1p1", project: CMIP5, variable = tas
27+
# TODO add links
28+
# Model = MPI-ESM-LR, ensemble: "r(1:2)i1p1", project: CMIP5, variable = tas
29+
# TODO add links
30+
# Model = UKESM1-0-LL, ensemble: "r(1:4)i1p1f2", grid: gn, project: CMIP6, variable = tas
31+
# TODO add links
32+
# Model = CanESM5, ensemble: "r(1:4)i1p2f1", grid: gn, project: CMIP6, variable = tas
33+
# TODO add links

setup.md

Lines changed: 4 additions & 35 deletions
Original file line numberDiff line numberDiff line change
@@ -270,43 +270,12 @@ For this tutorial you can download the required data files by
270270
4. On single single search result press `List files`
271271
5. At bottom of page click on `Show All Files`
272272
6. Find the datafile which starts with `thetaoga` in the list
273-
7. Use `HTTP Download` link to download the [thetaoga_Omon_HadGEM2-ES_historical_r1i1p1_185912-200512.nc](http://esgf-data1.ceda.ac.uk/thredds/fileServer/esg_dataroot/cmip5/output1/MOHC/HadGEM2-ES/historical/mon/ocean/Omon/r1i1p1/v20110916/thetaoga/thetaoga_Omon_HadGEM2-ES_historical_r1i1p1_185912-200512.nc)) file to `~/default_inputpath/` directory
274-
275-
The tutorial also needs the following data files, we will use deep links instead of going through the search form. Please download all the links below to `~/default_inputpath/` directory:
276-
277-
- Variable = ts, model = HadGEM2-ES
278-
- [ts_Amon_HadGEM2-ES_historical_r1i1p1_188412-190911.nc](http://esgf-data1.ceda.ac.uk/thredds/fileServer/esg_dataroot/cmip5/output1/MOHC/HadGEM2-ES/historical/mon/atmos/Amon/r1i1p1/v20120928/ts/ts_Amon_HadGEM2-ES_historical_r1i1p1_188412-190911.nc)
279-
- [ts_Amon_HadGEM2-ES_historical_r1i1p1_190912-193411.nc](http://esgf-data1.ceda.ac.uk/thredds/fileServer/esg_dataroot/cmip5/output1/MOHC/HadGEM2-ES/historical/mon/atmos/Amon/r1i1p1/v20120928/ts/ts_Amon_HadGEM2-ES_historical_r1i1p1_190912-193411.nc)
280-
- [ts_Amon_HadGEM2-ES_historical_r1i1p1_195912-198411.nc](http://esgf-data1.ceda.ac.uk/thredds/fileServer/esg_dataroot/cmip5/output1/MOHC/HadGEM2-ES/historical/mon/atmos/Amon/r1i1p1/v20120928/ts/ts_Amon_HadGEM2-ES_historical_r1i1p1_195912-198411.nc)
281-
- [ts_Amon_HadGEM2-ES_historical_r1i1p1_198412-200511.nc](http://esgf-data1.ceda.ac.uk/thredds/fileServer/esg_dataroot/cmip5/output1/MOHC/HadGEM2-ES/historical/mon/atmos/Amon/r1i1p1/v20120928/ts/ts_Amon_HadGEM2-ES_historical_r1i1p1_198412-200511.nc)
282-
- Variable = tas, model = HadGEM2-AO
283-
- TODO add links
284-
- Variable = tas, model = HadGEM2-ES
285-
- [tas_Amon_HadGEM2-ES_historical_r1i1p1_188412-190911.nc](http://esgf-data1.ceda.ac.uk/thredds/fileServer/esg_dataroot/cmip5/output1/MOHC/HadGEM2-ES/historical/mon/atmos/Amon/r1i1p1/v20120928/tas/tas_Amon_HadGEM2-ES_historical_r1i1p1_188412-190911.nc)
286-
- [tas_Amon_HadGEM2-ES_historical_r1i1p1_190912-193411.nc](http://esgf-data1.ceda.ac.uk/thredds/fileServer/esg_dataroot/cmip5/output1/MOHC/HadGEM2-ES/historical/mon/atmos/Amon/r1i1p1/v20120928/tas/tas_Amon_HadGEM2-ES_historical_r1i1p1_190912-193411.nc)
287-
- [tas_Amon_HadGEM2-ES_historical_r1i1p1_195912-198411.nc](http://esgf-data1.ceda.ac.uk/thredds/fileServer/esg_dataroot/cmip5/output1/MOHC/HadGEM2-ES/historical/mon/atmos/Amon/r1i1p1/v20120928/tas/tas_Amon_HadGEM2-ES_historical_r1i1p1_195912-198411.nc)
288-
- [tas_Amon_HadGEM2-ES_historical_r1i1p1_198412-200511.nc](http://esgf-data1.ceda.ac.uk/thredds/fileServer/esg_dataroot/cmip5/output1/MOHC/HadGEM2-ES/historical/mon/atmos/Amon/r1i1p1/v20120928/tas/tas_Amon_HadGEM2-ES_historical_r1i1p1_198412-200511.nc)
289-
- Variable = tos, model = HadGEM2-AO
290-
- TODO add links
291-
- Variable = tos, model = HadGEM2-CC
292-
- TODO add links
293-
- Variable = tos, model = HadGEM2-ES
294-
- TODO add links
295-
- Model = UKESM1-0-LL, project = CMIP6, Experiment = historical, ensemble= r1i1p1f2, variable = pr and tas
296-
- TODO add links
297-
- Model = CanESM2, ensemble: "r(1:4)i1p1", project: CMIP5, variable = tas
298-
- TODO add links
299-
- Model = MPI-ESM-LR, ensemble: "r(1:2)i1p1", project: CMIP5, variable = tas
300-
- TODO add links
301-
- Model = UKESM1-0-LL, ensemble: "r(1:4)i1p1f2", grid: gn, project: CMIP6, variable = tas
302-
- TODO add links
303-
- Model = CanESM5, ensemble: "r(1:4)i1p2f1", grid: gn, project: CMIP6, variable = tas
304-
- TODO add links
305-
306-
To download all these files at once use the [dataset.urls](https://github.com/ESMValGroup/ESMValTool_Tutorial/raw/master/data/recipe_example.yml) file and wget
273+
7. Use `HTTP Download` link to download the [thetaoga_Omon_HadGEM2-ES_historical_r1i1p1_185912-200512.nc](http://esgf-data1.ceda.ac.uk/thredds/fileServer/esg_dataroot/cmip5/output1/MOHC/HadGEM2-ES/historical/mon/ocean/Omon/r1i1p1/v20110916/thetaoga/thetaoga_Omon_HadGEM2-ES_historical_r1i1p1_185912-200512.nc)) file to
274+
275+
The tutorial needs the more data files, we will use deep links instead of going through the search form. To download all dataset files to `~/default_inputpath/` directory use the [dataset.urls](https://github.com/ESMValGroup/ESMValTool_Tutorial/raw/master/data/recipe_example.yml) file and [wget](https://en.wikipedia.org/wiki/Wget):
307276

308277
~~~shell
309-
wget --input-file dataset.urls --no-clobber --directory-prefix $HOME/default_inputpath/
278+
wget --input-file https://github.com/ESMValGroup/ESMValTool_Tutorial/raw/master/data/recipe_example.yml --no-clobber --directory-prefix $HOME/default_inputpath/
310279
~~~
311280

312281
You will also need to able to use:

0 commit comments

Comments
 (0)