Poetry dependencies cache behaviour

[radekbenkel]

Hello,

If I have two projects (in this case identical, but that shouldn't be the case) I would assume that when installing the same dependency again poetry will not be downloading dependencies for the second time. Unfortunately, it does, which is marked by Downloading... xxx% during second run.

Log of my operations below:

[/private/tmp/test-a]
$ ls
pyproject.toml
[/private/tmp/test-a]
$ cat pyproject.toml
[tool.poetry]
name = "test"
version = "0.1.0"
description = ""
authors = ["None"]

[tool.poetry.dependencies]
python = "^3.9"
fastapi = "^0.75.0"

[/private/tmp/test-a]
$ poetry install -vvv
Loading configuration file /Users/[redacted]/Library/Application Support/pypoetry/config.toml
Loading configuration file /Users/[redacted]/Library/Application Support/pypoetry/auth.toml
Creating virtualenv test in /private/tmp/test-a/.venv
Using virtualenv: /private/tmp/test-a/.venv
Updating dependencies
Resolving dependencies...
   1: fact: test is 0.1.0
   1: derived: test
   1: fact: test depends on fastapi (^0.75.0)
   1: selecting test (0.1.0)
   1: derived: fastapi (>=0.75.0,<0.76.0)
   1: fact: fastapi (0.75.0) depends on starlette (0.17.1)
   1: fact: fastapi (0.75.0) depends on pydantic (>=1.6.2,<1.7 || >1.7,<1.7.1 || >1.7.1,<1.7.2 || >1.7.2,<1.7.3 || >1.7.3,<1.8 || >1.8,<1.8.1 || >1.8.1,<2.0.0)
   1: selecting fastapi (0.75.0)
   1: derived: pydantic (>=1.6.2,!=1.7,!=1.7.1,!=1.7.2,!=1.7.3,!=1.8,!=1.8.1,<2.0.0)
   1: derived: starlette (==0.17.1)
   1: fact: starlette (0.17.1) depends on anyio (>=3.0.0,<4)
   1: selecting starlette (0.17.1)
   1: derived: anyio (>=3.0.0,<4)
   1: fact: pydantic (1.9.0) depends on typing-extensions (>=3.7.4.3)
   1: selecting pydantic (1.9.0)
   1: derived: typing-extensions (>=3.7.4.3)
   1: selecting typing-extensions (4.1.1)
   1: fact: anyio (3.5.0) depends on idna (>=2.8)
   1: fact: anyio (3.5.0) depends on sniffio (>=1.1)
   1: selecting anyio (3.5.0)
   1: derived: sniffio (>=1.1)
   1: derived: idna (>=2.8)
   1: selecting sniffio (1.2.0)
   1: selecting idna (3.3)
   1: Version solving took 0.184 seconds.
   1: Tried 1 solutions.

Writing lock file

Finding the necessary packages for the current system

Package operations: 7 installs, 0 updates, 0 removals

  • Installing idna (3.3): Pending...
  • Installing idna (3.3): Downloading... 100%
  • Installing idna (3.3): Installing...
  • Installing idna (3.3)
  • Installing sniffio (1.2.0): Pending...
  • Installing sniffio (1.2.0): Downloading... 100%
  • Installing sniffio (1.2.0): Installing...
  • Installing sniffio (1.2.0)
  • Installing anyio (3.5.0): Pending...
  • Installing anyio (3.5.0): Downloading... 100%
  • Installing anyio (3.5.0): Installing...
  • Installing anyio (3.5.0)
  • Installing typing-extensions (4.1.1): Pending...
  • Installing typing-extensions (4.1.1): Downloading... 100%
  • Installing typing-extensions (4.1.1): Installing...
  • Installing typing-extensions (4.1.1)
  • Installing pydantic (1.9.0): Pending...
  • Installing pydantic (1.9.0): Downloading... 100%
  • Installing pydantic (1.9.0): Installing...
  • Installing pydantic (1.9.0)
  • Installing starlette (0.17.1): Pending...
  • Installing starlette (0.17.1): Downloading... 100%
  • Installing starlette (0.17.1): Installing...
  • Installing starlette (0.17.1)
  • Installing fastapi (0.75.0): Pending...
  • Installing fastapi (0.75.0): Downloading... 100%
  • Installing fastapi (0.75.0): Installing...
  • Installing fastapi (0.75.0)
  
  
[/private/tmp/test-a]
$ mkdir ../test-b
[/private/tmp/test-a]
$ cp pyproject.toml ../test-b
[/private/tmp/test-a]
$ cp poetry.lock  ../test-b
[/private/tmp/test-a]
$ cd ../test-b
[/private/tmp/test-b]
$ poetry install -vvv
Loading configuration file /Users/[redacted]/Library/Application Support/pypoetry/config.toml
Loading configuration file /Users/[redacted]/Library/Application Support/pypoetry/auth.toml
Creating virtualenv test in /private/tmp/test-b/.venv
Using virtualenv: /private/tmp/test-b/.venv
Installing dependencies from lock file

Finding the necessary packages for the current system

Package operations: 7 installs, 0 updates, 0 removals

  • Installing idna (3.3): Pending...
  • Installing idna (3.3): Downloading... 100%
  • Installing idna (3.3): Installing...
  • Installing idna (3.3)
  • Installing sniffio (1.2.0): Pending...
  • Installing sniffio (1.2.0): Downloading... 100%
  • Installing sniffio (1.2.0): Installing...
  • Installing sniffio (1.2.0)
  • Installing anyio (3.5.0): Pending...
  • Installing anyio (3.5.0): Downloading... 100%
  • Installing anyio (3.5.0): Installing...
  • Installing anyio (3.5.0)
  • Installing typing-extensions (4.1.1): Pending...
  • Installing typing-extensions (4.1.1): Downloading... 100%
  • Installing typing-extensions (4.1.1): Installing...
  • Installing typing-extensions (4.1.1)
  • Installing pydantic (1.9.0): Pending...
  • Installing pydantic (1.9.0): Downloading... 100%
  • Installing pydantic (1.9.0): Installing...
  • Installing pydantic (1.9.0)
  • Installing starlette (0.17.1): Pending...
  • Installing starlette (0.17.1): Downloading... 100%
  • Installing starlette (0.17.1): Installing...
  • Installing starlette (0.17.1)
  • Installing fastapi (0.75.0): Pending...
  • Installing fastapi (0.75.0): Downloading... 100%
  • Installing fastapi (0.75.0): Installing...
  • Installing fastapi (0.75.0)

My config:

$ poetry config --list
cache-dir = "/Users/[redacted]/Library/Caches/pypoetry"
experimental.new-installer = true
installer.max-workers = null
installer.parallel = true

virtualenvs.create = true
virtualenvs.in-project = true
virtualenvs.options.always-copy = false
virtualenvs.options.system-site-packages = false
virtualenvs.path = "{cache-dir}/virtualenvs"  # /Users/[redacted]/Library/Caches/pypoetry/virtualenvs
virtualenvs.prefer-active-python = false

$ poetry --version
Poetry (version 1.2.0b1)

I'm on macOS. I checked and cache directory for pypi is created under ~/Library/Caches/pypoetry/cache/repositories after first installation.

What am I doing wrong? Did I miss some setting?

[TreeKat71]

Also want to know!
Right now I am building CI with poetry but the caching behavior is so confusing.
Would be great if there is document about it.