Automatic download of Eurostat datasets #166
Open
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
This PR uses the Eurostat API to automatically download datasets and save them into the policy compass backend in the correct format.
It's possible to try to download all or only selected datasets.
To download all datasets use the "python manage.py eurostat ALL" command.
Most of the eurostat datasets will be downloaded and saved. There are still a few datasets, that will cause errors because of their different formatting, but these datasets will be skipped and the script continues with the working datasets
To download one dataset, you can use the "python manage.py eurostat " command.
For example you can use "python manage.py eurostat for_remov" to download the "for_remov" dataset.
If more datasets should be downloaded, you can add more eurostat-codes to the arguments. For example "python manage.py eurostat for_remov for_basic".