Skip to content

Commit 5bc9f72

Browse files
authored
update for current ECMWF version. Tested and works (#38)
1 parent 947da07 commit 5bc9f72

File tree

3 files changed

+1
-65
lines changed

3 files changed

+1
-65
lines changed

README.md

Lines changed: 0 additions & 52 deletions
Original file line numberDiff line numberDiff line change
@@ -52,55 +52,3 @@ Usage
5252

5353
for file in ./mss/*.nc; do mv "$file" "${file/.nc/.EUR_LL015.nc}"; done
5454
mv ./mss/*.nc ~/mss/testdata
55-
56-
57-
ECMWF forecast
58-
==============
59-
60-
61-
ECTrans Setup
62-
-------------
63-
64-
1. Login at https://ecaccess.ecmwf.int/ecmwf/ \
65-
Go to https://ecaccess.ecmwf.int/ecmwf/gateway/ECtrans/Setup
66-
2. Click "Add association" at the bottom of the page \
67-
Call the association "MSS-Data-Transfer" and set up your SFTP/FTP Server to your liking \
68-
If you want to call it something else, make sure to change `ectrans_id` inside the `settings.config`
69-
70-
71-
Scripts Setup
72-
-------------
73-
74-
1. Clone this repository and move into it
75-
76-
git clone https://github.com/Open-MSS/data-retrieval.git
77-
cd data-retrieval
78-
79-
2. Install all requirements
80-
81-
pip3 install --user -r requirements.txt
82-
83-
3. Copy the settings.example to settings.config and adjust the configuration
84-
to your liking; here, you may also overwrite the values set already in
85-
settings.default.
86-
87-
88-
Usage
89-
-----
90-
After completing both setups, you can use this script as follows:
91-
92-
* The default settings are located in settings.default. It is set to the forecast
93-
for 36h from today 0:00 UTC for a certain domain and resolution. You may add (or edit)
94-
a file named settings.config with specific environment variable settings
95-
(e.g. like export DAY=22 ; export MONTH=12; export YEAR=2021; export GRID=0.5/0.5)
96-
and run the script locally by ./bin/get\_ecmwf.sh or as a batch job by
97-
sbatch ./bin/get\_ecmwf.sh
98-
* If it is run as a batch job using the MSJ trigger system, init and forecast times
99-
that are then automatically stored in the environment variables MSJ* will be used instead
100-
With the trigger, the job ist started when a specific forecast is available,
101-
e.g. fc00h036 for the 36h forecast. It can be started either form the ecaccess website
102-
or by typing
103-
ecaccess-job-submit -ni fc00h036 bin/get_ecmwf.sh (automatic daily job renewal)
104-
or
105-
ecaccess-job-submit -ni fc00h036 -noRenew bin/get_ecmwf.sh (job runs once)
106-

requirements.txt

Lines changed: 0 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,7 +1,6 @@
11
cdsapi
22
cfgrib
33
eccodes
4-
python-eccodes
54
MetPy
65
tqdm
76
xarray

settings.example

Lines changed: 1 addition & 12 deletions
Original file line numberDiff line numberDiff line change
@@ -1,19 +1,8 @@
11
# Do not leave any whitespaces
22
# variable=value
33

4-
module load cdo/new
5-
module load nco
6-
7-
PREF=${CONDA_PREFIX##*/}
8-
if [[ $PREF != mambaforge && $PREF != ncenv ]]
9-
then
10-
PATH=$HOME/mambaforge/bin/:$PATH
11-
fi
12-
. $HOME/mambaforge/etc/profile.d/conda.sh
13-
conda activate ncenv
14-
154
# write data to the $SCRATCH directory with more available disk quota
16-
export WORKDIR=$SCRATCH
5+
export WORKDIR=$HOME/data-retrieval
176

187
export PYTHON=python3
198
export CLEANUP=no

0 commit comments

Comments
 (0)