model installation via PDM using pyproject.toml

[lsmith77]

I am trying to cache dependencies between builds. So basically I want to use rsync to restore the files and then run the installer. if nothing has changes, it should get done quickly. Now using spacy download isn’t compatible with this approach and it would require some additional steps to check if the model needs to be downloaded again or not.

So my question: is it possible to install spacy models via pyproject.toml (while using PDM)?

I was hoping something like the following would work but it doesn't seen to be the case:

dependencies = [
    ...
    "en-core-web-sm @ https://github.com/explosion/spacy-models/releases/download/en_core_web_sm-3.5.0/en_core_web_sm-3.5.0.tar.gz",
    "de-core-news-lg @ https://github.com/explosion/spacy-models/releases/download/de_core_news_lg-3.5.0/de_core_news_lg-3.5.0.tar.gz",
]

But this leads to:

OSError: [E050] Can't find model 'en_core_web_md'. It doesn't seem to be a Python package or a valid path to a data directory.

[lsmith77]

related to this I found:
https://stackoverflow.com/questions/60220639/how-to-cache-spacy-model-in-gitlab-runner-when-building-docker-image

[lsmith77]

OK the following seems to work

    "en-core-web-sm @ https://github.com/explosion/spacy-models/releases/download/en_core_web_md-3.5.0/en_core_web_md-3.5.0-py3-none-any.whl",
    "de-core-news-lg @ https://github.com/explosion/spacy-models/releases/download/de_core_news_lg-3.5.0/de_core_news_lg-3.5.0-py3-none-any.whl",