Can no longer install versions 1.5.10-1.6.5

[JonathanBhimani-Burrows]

Bug description

Hey everyone,
I have been working on the same server for the past few months ( w/ RTX6000) without issue
Recently, I tried to re-install lightning 1.5.10 (new virtual environment, python 3.9.18), and got the error below
I tried versions up to 1.6.5 with the same error
I can't use the newest version, as that will require a torch upgrade (currently using 1.13.1 due to specific versioning issues)
This popped up in the last month, I'm wondering if anyone else is seeing this problem or if it is to be expected for some reason?
Thanks,
Jonathan

What version are you seeing the problem on?

v1.x

How to reproduce the bug

Create a virtual environment with python 3.9.18
Activate
pip install pytorch-lightning==1.5.10

Error messages and logs

ERROR: Could not find a version that satisfies the requirement pytorch-lightning==1.5.10 (from versions: 0.0.2, 0.2, 0.2.2, 0.2.3, 0.2.4, 0.2.4.1, 0.2.5, 0.2.5.1, 0.2.5.2, 0.2.6, 0.3, 0.3.1, 0.3.2, 0.3.3, 0.3.4, 0.3.4.1, 0.3.5, 0.3.6, 0.3.6.1, 0.3.6.3, 0.3.6.4, 0.3.6.5, 0.3.6.6, 0.3.6.7, 0.3.6.8, 0.3.6.9, 0.4.0, 0.4.1, 0.4.2, 0.4.3, 0.4.4, 0.4.5, 0.4.6, 0.4.7, 0.4.8, 0.4.9, 0.5.0, 0.5.1, 0.5.1.2, 0.5.1.3, 0.5.2, 0.5.2.1, 0.5.3, 0.5.3.1, 0.5.3.2, 0.5.3.3, 0.6.0, 0.7.1, 0.7.3, 0.7.5, 0.7.6, 0.8.1, 0.8.3, 0.8.4, 0.8.5, 0.9.0, 0.10.0, 1.0.0, 1.0.1, 1.0.2, 1.0.3, 1.0.4, 1.0.5, 1.0.6, 1.0.7, 1.0.8, 1.1.0, 1.1.1, 1.1.2, 1.1.3, 1.1.4, 1.1.5, 1.1.6, 1.1.7, 1.1.8, 1.2.0rc0, 1.2.0rc1, 1.2.0rc2, 1.2.0, 1.2.1, 1.2.2, 1.2.3, 1.2.4, 1.2.5, 1.2.6, 1.2.7, 1.2.8, 1.2.9, 1.2.10, 1.3.0rc1, 1.3.0rc2, 1.3.0rc3, 1.3.0, 1.3.1, 1.3.2, 1.3.3, 1.3.4, 1.3.5, 1.3.6, 1.3.7, 1.3.7.post0, 1.3.8, 1.4.0rc0, 1.4.0rc1, 1.4.0rc2, 1.4.0, 1.4.1, 1.4.2, 1.4.3, 1.4.4, 1.4.5, 1.4.6, 1.4.7, 1.4.8, 1.4.9, 1.5.0rc0, 1.5.0rc1, 1.5.0, 1.5.1, 1.5.2, 1.5.3, 1.5.4, 1.5.5, 1.5.6, 1.5.7, 1.5.8, 1.5.9, 1.5.10, 1.6.0rc0, 1.6.0rc1, 1.6.0, 1.6.1, 1.6.2, 1.6.3, 1.6.4, 1.6.5, 1.7.0rc0, 1.7.0rc1, 1.7.0, 1.7.1, 1.7.2, 1.7.3, 1.7.4, 1.7.5, 1.7.6, 1.7.7, 1.8.0rc0, 1.8.0rc1, 1.8.0rc2, 1.8.0, 1.8.0.post1, 1.8.1, 1.8.2, 1.8.3, 1.8.3.post0, 1.8.3.post1, 1.8.3.post2, 1.8.4, 1.8.4.post0, 1.8.5, 1.8.5.post0, 1.8.6, 1.9.0rc0, 1.9.0, 1.9.1, 1.9.2, 1.9.3, 1.9.4, 1.9.5, 2.0.0rc0, 2.0.0, 2.0.1, 2.0.1.post0, 2.0.2, 2.0.3, 2.0.4, 2.0.5, 2.0.6, 2.0.7, 2.0.8, 2.0.9, 2.0.9.post0, 2.1.0rc0, 2.1.0rc1, 2.1.0, 2.1.1, 2.1.2, 2.1.3, 2.1.4, 2.2.0rc0, 2.2.0, 2.2.0.post0, 2.2.1, 2.2.2, 2.2.3, 2.2.4, 2.2.5, 2.3.0, 2.3.1, 2.3.2, 2.3.3, 2.4.0)
ERROR: No matching distribution found for pytorch-lightning==1.5.10

Environment

Current environment

  <summary>Current environment</summary>

* CUDA:
        - GPU:
                - NVIDIA RTX 6000 Ada Generation
        - available:         True
        - version:           11.6
* Lightning:
        - pytorch-tabnet:    3.0.0
        - torch:             1.13.1+cu116
        - torchaudio:        0.13.1+cu116
        - torchmetrics:      0.11.0
        - torchvision:       0.14.1+cu116
* Packages:
        - absl-py:           1.3.0
        - aiohttp:           3.8.3
        - aiosignal:         1.3.1
        - alembic:           1.13.2
        - aniso8601:         9.0.1
        - antlr4-python3-runtime: 4.9.3
        - association-metrics: 0.0.1
        - asttokens:         2.2.1
        - async-timeout:     4.0.2
        - attrs:             22.2.0
        - autocommand:       2.2.2
        - backcall:          0.2.0
        - backports.tarfile: 1.2.0
        - brotlipy:          0.7.0
        - cachetools:        5.2.0
        - category-encoders: 2.2.2
        - certifi:           2020.6.20
        - cffi:              1.17.0
        - charset-normalizer: 2.1.1
        - click:             8.1.3
        - cloudpickle:       3.0.0
        - comm:              0.1.2
        - configparser:      5.3.0
        - contourpy:         1.0.6
        - cycler:            0.11.0
        - databricks-cli:    0.17.4
        - databricks-sdk:    0.30.0
        - datasets:          2.10.1
        - debugpy:           1.6.5
        - decorator:         5.1.1
        - deprecated:        1.2.14
        - dill:              0.3.6
        - docker:            7.1.0
        - docker-pycreds:    0.4.0
        - einops:            0.3.0
        - entrypoints:       0.4
        - executing:         1.2.0
        - filelock:          3.9.0
        - flask:             2.2.3
        - fonttools:         4.38.0
        - frozenlist:        1.3.3
        - fsspec:            2022.11.0
        - future:            0.18.2
        - gitdb:             4.0.10
        - gitpython:         3.1.30
        - google-auth:       2.15.0
        - google-auth-oauthlib: 0.4.6
        - gputil:            1.4.0
        - graphene:          3.3
        - graphql-core:      3.2.3
        - graphql-relay:     3.2.0
        - greenlet:          3.0.3
        - grpcio:            1.51.1
        - gunicorn:          22.0.0
        - huggingface-hub:   0.13.0
        - idna:              3.4
        - importlib-metadata: 6.0.0
        - importlib-resources: 6.4.0
        - inflect:           7.3.1
        - ipykernel:         6.19.4
        - ipython:           8.8.0
        - ipywidgets:        8.0.4
        - itsdangerous:      2.1.2
        - jaraco.context:    5.3.0
        - jaraco.functools:  4.0.1
        - jaraco.text:       3.12.1
        - jedi:              0.18.2
        - jinja2:            3.1.4
        - joblib:            1.2.0
        - jupyter-client:    7.4.8
        - jupyter-core:      5.1.2
        - jupyterlab-widgets: 3.0.5
        - kiwisolver:        1.4.4
        - kornia:            0.7.3
        - kornia-rs:         0.1.5
        - llvmlite:          0.43.0
        - mako:              1.3.5
        - markdown:          3.4.1
        - markupsafe:        2.1.1
        - matplotlib:        3.6.2
        - matplotlib-inline: 0.1.6
        - mlflow:            2.15.1
        - mlflow-skinny:     2.15.1
        - more-itertools:    10.3.0
        - multidict:         6.0.4
        - multiprocess:      0.70.14
        - nest-asyncio:      1.5.6
        - numba:             0.60.0
        - numpy:             1.24.2
        - oauthlib:          3.2.2
        - omegaconf:         2.3.0
        - opentelemetry-api: 1.26.0
        - opentelemetry-sdk: 1.26.0
        - opentelemetry-semantic-conventions: 0.47b0
        - ordered-set:       4.1.0
        - packaging:         22.0
        - pandas:            1.1.5
        - parso:             0.8.3
        - patsy:             0.5.3
        - pexpect:           4.8.0
        - pickleshare:       0.7.5
        - pillow:            9.4.0
        - pip:               24.2
        - platformdirs:      2.6.2
        - plotly:            4.14.3
        - ply:               3.11
        - promise:           2.3
        - prompt-toolkit:    3.0.36
        - protobuf:          3.20.3
        - psutil:            5.9.4
        - ptyprocess:        0.7.0
        - pure-eval:         0.2.2
        - pyarrow:           11.0.0
        - pyasn1:            0.4.8
        - pyasn1-modules:    0.2.8
        - pycparser:         2.22
        - pydeprecate:       0.3.1
        - pygments:          2.14.0
        - pyjwt:             2.6.0
        - pyparsing:         3.0.9
        - pyqt5-sip:         12.11.0
        - python-dateutil:   2.8.2
        - pytorch-tabnet:    3.0.0
        - pytz:              2022.7
        - pyyaml:            5.4.1
        - pyzmq:             24.0.1
        - querystring-parser: 1.2.4
        - regex:             2022.10.31
        - requests:          2.28.1
        - requests-oauthlib: 1.3.1
        - responses:         0.18.0
        - retrying:          1.3.4
        - rsa:               4.9
        - scikit-learn:      1.2.0
        - scipy:             1.10.0
        - seaborn:           0.12.2
        - sentry-sdk:        1.12.1
        - setuptools:        72.1.0
        - shap:              0.45.0
        - shortuuid:         1.0.11
        - six:               1.16.0
        - slicer:            0.0.7
        - smmap:             5.0.0
        - sqlalchemy:        2.0.32
        - sqlparse:          0.5.1
        - stack-data:        0.6.2
        - statsmodels:       0.13.5
        - subprocess32:      3.5.4
        - tabulate:          0.9.0
        - tensorboard:       2.11.0
        - tensorboard-data-server: 0.6.1
        - tensorboard-plugin-wit: 1.8.1
        - threadpoolctl:     3.1.0
        - tokenizers:        0.13.2
        - tomli:             2.0.1
        - torch:             1.13.1+cu116
        - torchaudio:        0.13.1+cu116
        - torchmetrics:      0.11.0
        - torchvision:       0.14.1+cu116
        - tornado:           6.2
        - tqdm:              4.64.1
        - traitlets:         5.8.0
        - transformers:      4.26.1
        - typeguard:         4.3.0
        - typing-extensions: 4.12.2
        - urllib3:           1.26.13
        - wandb:             0.10.11
        - watchdog:          2.2.1
        - wcwidth:           0.2.5
        - webencodings:      0.5.1
        - werkzeug:          2.2.2
        - wheel:             0.43.0
        - widgetsnbextension: 4.0.5
        - wrapt:             1.16.0
        - xxhash:            3.2.0
        - yarl:              1.8.2
        - zipp:              3.11.0
* System:
        - OS:                Linux
        - architecture:
                - 64bit
                - ELF
        - processor:         x86_64
        - python:            3.9.18
        - release:           6.2.0-37-generic
        - version:           #38~22.04.1-Ubuntu SMP PREEMPT_DYNAMIC Thu Nov  2 18:01:13 UTC 2

More info

No response

[JonathanBhimani-Burrows]

Any update on this? Is this a mistake on our side, or is this expected?

[fsbarros98]

Same problem here!

[heitorrapela]

Hey, I am facing the same problem!

I hope they fix, otherwise it is going to break a lot of my dependencies.

Do you know what is happening here @Borda ?

[Borda]

This seems as pypi issue =/
Why would you need this very old version?

[heitorrapela]

In my case, I had some envs and projects with this version, so if someone wants to reproduce the results, I can at least guarantee that it is going to work; for the new version, I cannot say the same without re-run everything again with the latest version, which problem will not work due to lot of new modifications on the backend of the lib (like changes in some functions).

[JonathanBhimani-Burrows]

We have several models fpr our clients that use the older version
For us to do a full migration, we would need to re-run all models for all clients to validate the results, and this is several weeks of work, which we do not have the time for now

[Borda]

Can try to install the version straight from pypi?
pip install https://files.pythonhosted.org/packages/ba/6b/1b3ce55d6b83d68abfecabdd4e36e72ebbde1367c4a1d43aad809951ed50/pytorch-lightning-1.6.5.tar.gz

[heitorrapela]

Did you have any error in your side?

ps: maybe is my python version 3.8.19

[haoai-1997]

python3.10+torch1.11+cuda11.3 face same issues while installing pytorch-lightning==1.7.7. It will enforce to install torch 2.5.1.

[lantiga]

The problem is the following

WARNING: Ignoring version 1.5.10 of pytorch-lightning since it has invalid metadata:
Requested pytorch-lightning==1.5.10 from https://files.pythonhosted.org/packages/18/f1/f59b307f75db1886c96e396eec878501510677394868680b8d2b8b58c47c/pytorch_lightning-1.5.10-py3-none-any.whl has invalid metadata: .* suffix can only be used with `==` or `!=` operators
    torch (>=1.7.*)
           ~~~~~~^
Please use pip<24.1 if you need to use this version.

Which derives from:
https://discuss.python.org/t/should-we-permit-with-more-comparision-operators-in-version-specifiers/22782

We may issue patch releases for old versions, but the fastest way to get the old package today is downgrade your pip.

[Borda]

ok, we can consider releasing post version witha fix... :)

[heitorrapela]

thanks @lantiga and @Borda :)

[Borda]

thanks @lantiga and @Borda :)

hello, added two post releases to the end of both series, pls check them out:

• https://pypi.org/project/pytorch-lightning/1.5.10.post0/
• https://pypi.org/project/pytorch-lightning/1.6.5.post0/