How do I specify arm64e vs. x86 in dependency fetching?

[femtomc]

I'm running into issues where poetry gets the "most relaxed" none platform wheels -- but I'm running on Apple M1 and so I can errors related to having a mix of arm64 wheels and x86 wheels, even for packages where I know a native ARM wheel is available.

I'd really like to be able to specify: get all platform consistent wheels.

How do I do this?

[neersighted]

Poetry should be preferring arm wheels wherever available -- we'll need your pyproject.toml and lock file to better understand what is going on.

[femtomc]

Which seems to be the case for lxml -- as I continue to search versions, not having luck.

[neersighted]

You could add direct URL dependencies (with correct platform markers specified by yourself) on the Conda wheels if you need to (as I don't think they provide a PEP 508-compatible repository Poetry can resolve from). I'd also suggest opening an issue to see if we can figure out how Poetry (or rather, packaging) is selecting a x86_64 wheel on an ARM Mac (and why pip installs it) -- though I would appreciate you testing with a non-Conda Python version first.

I wonder if the Python that Conda builds pretends to be amd64 compatible (or if that's something Python does in general and I've never noticed -- my knowledge here is limited) as Rosetta 2 can load an Intel shared object into an ARM64 process. Attempting to reproduce the incorrect wheels being installed on a clean Python.org build of Python would be appreciated. If it does reproduce on a pyenv/python-build produced version, I would most certainly open an issue.

[neersighted]

Also, if we make sure to not select incorrect wheels, a sdist build should work just fine. Wheels are just a way to avoid compiling native code (or needing the native libraries/headers locally), but Poetry can build lxml from source just fine... So understanding why packaging is selecting the wrong wheels here is key, as if we fix that, the sdist-based fallback will work.

[femtomc]

Okay, I have to defer attempting to solve this until after some other work -- but I'll return to it later this week and add some more information.

[neersighted]

One final thought -- since you're on 1.2.x you can take advantage of installer.no-binary to force Poetry to ignore wheels -- poetry config --local installer.no-binary lxml should force a sdist-based install of lxml, for example.