Skip to content

Unnecessarily restrictive pyarrow constraint on Intel Mac with Python 3.13 #3183

@stainbank

Description

@stainbank

"pyarrow>=8.0.0,<18.0.0 ; sys_platform == 'darwin' and platform_machine == 'x86_64'",

Is it strictly necessary to restrict to pyarrow<18.0.0 for Apple MacOS (darwin) on an Intel Silicon machine (x86_64)?

Currently, this constraint means that when using Python 3.13, any attempt to install awswrangler with pip (or poetry etc.) cannot fetch the built pyarrow==17.0.0 wheel since none exists for Python 3.13 (only Python 3.8 -- 3.12). Leaving my only option being to build pyarrow from source, which is a pain.

Whereas there are prebuilt Python 3.13 wheels on this platform for all subsequent pyarrow releases, e.g.: https://pypi.org/project/pyarrow/#pyarrow-21.0.0-cp313-cp313t-macosx_12_0_x86_64.whl

If I use uv with dependency overrides then everything installs perfectly fine, but this is not an option for our team.

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions