GH-47443: [Python][Packaging] Drop Python 3.9 support by raulcd · Pull Request #47478 · apache/arrow

raulcd · 2025-09-02T15:32:48Z

Rationale for this change

Python 3.9 is End of Support on 31st October 2025. We can drop support for pyarrow 22.0.0.
See: https://endoflife.date/python

What changes are included in this PR?

Remove support for 3.9. Update minimum required Python version and update some CI jobs to use the minimum Python supported version

Are these changes tested?

They will be tested via CI and Archery

Are there any user-facing changes?

Yes in terms of not supporting older versions of Python. This will be a breaking change for some users but not for the API itself

GitHub Issue: [Python][Packaging] Drop Python 3.9 support #47443

github-actions · 2025-09-02T15:33:14Z

⚠️ GitHub issue #47443 has been automatically assigned in GitHub to PR creator.

raulcd · 2025-09-03T12:11:57Z

@github-actions crossbow submit -g python

github-actions · 2025-09-03T12:14:41Z

Revision: e6a2ef8

Submitted crossbow builds: ursacomputing/crossbow @ actions-f2bbc8c456

Task	Status
example-python-minimal-build-fedora-conda
example-python-minimal-build-ubuntu-venv
test-conda-python-3.10
test-conda-python-3.10-hdfs-2.9.2
test-conda-python-3.10-hdfs-3.2.1
test-conda-python-3.10-pandas-1.3.4-numpy-1.21.2
test-conda-python-3.11
test-conda-python-3.11-dask-latest
test-conda-python-3.11-dask-upstream_devel
test-conda-python-3.11-hypothesis
test-conda-python-3.11-pandas-latest-numpy-latest
test-conda-python-3.11-spark-master
test-conda-python-3.12
test-conda-python-3.12-cpython-debug
test-conda-python-3.12-pandas-latest-numpy-1.26
test-conda-python-3.12-pandas-latest-numpy-latest
test-conda-python-3.12-pandas-nightly-numpy-nightly
test-conda-python-3.12-pandas-upstream_devel-numpy-nightly
test-conda-python-3.13
test-conda-python-emscripten
test-cuda-python-ubuntu-22.04-cuda-11.7.1
test-debian-12-python-3-amd64
test-debian-12-python-3-i386
test-fedora-42-python-3
test-ubuntu-22.04-python-3
test-ubuntu-22.04-python-313-freethreading
test-ubuntu-24.04-python-3

raulcd · 2025-09-03T13:00:09Z

@github-actions crossbow submit -g wheel

github-actions · 2025-09-03T13:03:04Z

Revision: e6a2ef8

Submitted crossbow builds: ursacomputing/crossbow @ actions-1fe0f5e10d

Task	Status
python-sdist
wheel-macos-monterey-cp310-cp310-amd64
wheel-macos-monterey-cp310-cp310-arm64
wheel-macos-monterey-cp311-cp311-amd64
wheel-macos-monterey-cp311-cp311-arm64
wheel-macos-monterey-cp312-cp312-amd64
wheel-macos-monterey-cp312-cp312-arm64
wheel-macos-monterey-cp313-cp313-amd64
wheel-macos-monterey-cp313-cp313-arm64
wheel-macos-monterey-cp313-cp313t-amd64
wheel-macos-monterey-cp313-cp313t-arm64
wheel-manylinux-2-28-cp310-cp310-amd64
wheel-manylinux-2-28-cp310-cp310-arm64
wheel-manylinux-2-28-cp311-cp311-amd64
wheel-manylinux-2-28-cp311-cp311-arm64
wheel-manylinux-2-28-cp312-cp312-amd64
wheel-manylinux-2-28-cp312-cp312-arm64
wheel-manylinux-2-28-cp313-cp313-amd64
wheel-manylinux-2-28-cp313-cp313-arm64
wheel-manylinux-2-28-cp313-cp313t-amd64
wheel-manylinux-2-28-cp313-cp313t-arm64
wheel-musllinux-1-2-cp310-cp310-amd64
wheel-musllinux-1-2-cp310-cp310-arm64
wheel-musllinux-1-2-cp311-cp311-amd64
wheel-musllinux-1-2-cp311-cp311-arm64
wheel-musllinux-1-2-cp312-cp312-amd64
wheel-musllinux-1-2-cp312-cp312-arm64
wheel-musllinux-1-2-cp313-cp313-amd64
wheel-musllinux-1-2-cp313-cp313-arm64
wheel-musllinux-1-2-cp313-cp313t-amd64
wheel-musllinux-1-2-cp313-cp313t-arm64
wheel-windows-cp310-cp310-amd64
wheel-windows-cp311-cp311-amd64
wheel-windows-cp312-cp312-amd64
wheel-windows-cp313-cp313-amd64
wheel-windows-cp313-cp313t-amd64

raulcd · 2025-09-03T13:50:38Z

@github-actions crossbow submit python-sdist

github-actions · 2025-09-03T13:52:54Z

Revision: 1a93e2d

Submitted crossbow builds: ursacomputing/crossbow @ actions-d6131de9fb

Task	Status
python-sdist

raulcd · 2025-09-03T13:55:21Z

@github-actions crossbow submit wheel-manylinux-cp312

raulcd · 2025-09-03T13:56:12Z

@github-actions crossbow submit almalinux-8-*

github-actions · 2025-09-03T13:57:37Z

Revision: d3b86df

Submitted crossbow builds: ursacomputing/crossbow @ actions-57dbfc6a95

Task	Status
wheel-manylinux-2-28-cp312-cp312-amd64
wheel-manylinux-2-28-cp312-cp312-arm64

github-actions · 2025-09-03T13:58:21Z

Revision: d3b86df

Submitted crossbow builds: ursacomputing/crossbow @ actions-8cec7add92

Task	Status
almalinux-8-amd64
almalinux-8-arm64

raulcd · 2025-09-03T14:30:28Z

@github-actions crossbow submit almalinux-8-*

github-actions · 2025-09-03T14:32:41Z

Revision: 59d506c

Submitted crossbow builds: ursacomputing/crossbow @ actions-85a6c18ceb

Task	Status
almalinux-8-amd64
almalinux-8-arm64

raulcd · 2025-09-03T14:55:43Z

@github-actions crossbow submit almalinux-8-*

github-actions · 2025-09-03T14:57:53Z

Revision: ea2eebb

Submitted crossbow builds: ursacomputing/crossbow @ actions-598c97696a

Task	Status
almalinux-8-amd64
almalinux-8-arm64

raulcd · 2025-09-03T15:43:43Z

@github-actions crossbow submit python-sdist

raulcd · 2025-09-04T09:18:49Z

The Windows wheels failures are being tackled on a different PR where I am currently working on

kou

+1

python/pyproject.toml

Co-authored-by: Sutou Kouhei <kou@cozmixng.org>

raulcd · 2025-09-08T07:33:48Z

@AlenkaF @rok @pitrou , I'll merge this tomorrow, are you ok with it?

.github/workflows/archery.yml

.github/workflows/python.yml

dev/tasks/tasks.yml

jorisvandenbossche · 2025-09-08T08:47:33Z

docs/source/python/install.rst

 --------------------

-PyArrow is currently compatible with Python 3.9, 3.10, 3.11, 3.12 and 3.13.
+PyArrow is currently compatible with Python 3.10, 3.11, 3.12 and 3.13.


A bit lower down in this file, there is a listing of the optional dependencies and the minimal versions we support. That could be updated?

Although, for example for pandas, we strictly speaking still support pandas >= 1.0, even though we only test with pandas 1.3, since that is the version we check for in python/pyarrow/pandas-shim.pxi

I think that that could be bumped, but can also be for separate issue

I'll bump to:

* **NumPy 1.21.2** or higher. * **pandas 1.3.4** or higher,

because we might be able to build with pandas 1.0 but there's no Python wheel for a supported Python version so I think it's still worth bumping the docs too, we can bump python/pyarrow/pandas-shim.pxi on a follow up PR.

…or some jobs to Python 3.12 and update docs

conbench-apache-arrow · 2025-09-09T15:18:44Z

After merging your PR, Conbench analyzed the 4 benchmarking runs that have been run so far on merge-commit aedb752.

There weren't enough matching historic benchmark results to make a call on whether there were regressions.

The full Conbench report has more details.

…7478) ### Rationale for this change Python 3.9 is End of Support on 31st October 2025. We can drop support for pyarrow 22.0.0. See: https://endoflife.date/python ### What changes are included in this PR? Remove support for 3.9. Update minimum required Python version and update some CI jobs to use the minimum Python supported version ### Are these changes tested? They will be tested via CI and Archery ### Are there any user-facing changes? Yes in terms of not supporting older versions of Python. This will be a breaking change for some users but not for the API itself * GitHub Issue: apache#47443 Lead-authored-by: Raúl Cumplido <raulcumplido@gmail.com> Co-authored-by: Sutou Kouhei <kou@cozmixng.org> Signed-off-by: Raúl Cumplido <raulcumplido@gmail.com>

github-actions bot added Component: R Component: Python Component: Documentation awaiting committer review Awaiting committer review labels Sep 2, 2025

raulcd added 2 commits September 3, 2025 10:00

apacheGH-47443: [Python][Packaging] Drop Python 3.9 support

cb7da31

Fix quotes on yaml for 3.10 Python version

1908395

raulcd force-pushed the GH-47443 branch from 8603018 to 1908395 Compare September 3, 2025 08:00

raulcd added 3 commits September 3, 2025 10:56

Fix minimum pandas and numpy versions with Py 3.10 support

a3d52fc

Add also quotes to numpy to 'fix' docker failure

f3fd309

Fix job name for matrix

e6a2ef8

Fix sdist Dockerfile to use a newer Ubuntu

1a93e2d

Use Python3.12 on Almalinux 8

d3b86df

Fix Python package name for Almalinux 8

59d506c

Remove unnecessary link for pip3

ea2eebb

raulcd requested review from AlenkaF, kou, rok and thisisnic as code owners September 4, 2025 09:18

kou approved these changes Sep 4, 2025

View reviewed changes

python/pyproject.toml Outdated Show resolved Hide resolved

github-actions bot added awaiting merge Awaiting merge and removed awaiting changes Awaiting changes labels Sep 4, 2025

Remove unnecessary constraint from pyproject.toml

f1f17cd

Co-authored-by: Sutou Kouhei <kou@cozmixng.org>

github-actions bot added awaiting changes Awaiting changes and removed awaiting merge Awaiting merge labels Sep 4, 2025

WillAyd approved these changes Sep 5, 2025

View reviewed changes

rok approved these changes Sep 8, 2025

View reviewed changes

github-actions bot added awaiting merge Awaiting merge and removed awaiting changes Awaiting changes labels Sep 8, 2025

AlenkaF approved these changes Sep 8, 2025

View reviewed changes

jorisvandenbossche approved these changes Sep 8, 2025

View reviewed changes

github-actions bot added awaiting changes Awaiting changes and removed awaiting merge Awaiting merge labels Sep 8, 2025

Code review comments, bump some jobs to Python 3.13, update version f…

f053e2d

…or some jobs to Python 3.12 and update docs

github-actions bot added awaiting change review Awaiting change review and removed awaiting changes Awaiting changes labels Sep 8, 2025

raulcd merged commit aedb752 into apache:main Sep 9, 2025
35 checks passed

raulcd removed the awaiting change review Awaiting change review label Sep 9, 2025

raulcd mentioned this pull request Sep 9, 2025

[Python][Packaging] Drop Python 3.9 support #47443

Closed

rok mentioned this pull request Oct 13, 2025

GH-32609: [Python] Add type annotations to PyArrow #47609

Draft

dangotbanned mentioned this pull request Oct 13, 2025

Drop support for Python 3.9 narwhals-dev/narwhals#3204

Open

25 tasks

Conversation

raulcd commented Sep 2, 2025 • edited by github-actions bot Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Rationale for this change

What changes are included in this PR?

Are these changes tested?

Are there any user-facing changes?

Uh oh!

github-actions bot commented Sep 2, 2025

Uh oh!

raulcd commented Sep 3, 2025

Uh oh!

github-actions bot commented Sep 3, 2025

Uh oh!

raulcd commented Sep 3, 2025

Uh oh!

github-actions bot commented Sep 3, 2025

Uh oh!

raulcd commented Sep 3, 2025

Uh oh!

github-actions bot commented Sep 3, 2025

Uh oh!

raulcd commented Sep 3, 2025

Uh oh!

raulcd commented Sep 3, 2025

Uh oh!

github-actions bot commented Sep 3, 2025

Uh oh!

github-actions bot commented Sep 3, 2025

Uh oh!

raulcd commented Sep 3, 2025

Uh oh!

github-actions bot commented Sep 3, 2025

Uh oh!

raulcd commented Sep 3, 2025

Uh oh!

github-actions bot commented Sep 3, 2025

Uh oh!

raulcd commented Sep 3, 2025

Uh oh!

raulcd commented Sep 4, 2025

Uh oh!

kou left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

raulcd commented Sep 8, 2025

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

jorisvandenbossche Sep 8, 2025

Choose a reason for hiding this comment

Uh oh!

jorisvandenbossche Sep 8, 2025

Choose a reason for hiding this comment

Uh oh!

raulcd Sep 8, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Uh oh!

conbench-apache-arrow bot commented Sep 9, 2025

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

6 participants

raulcd commented Sep 2, 2025 •

edited by github-actions bot

Loading

raulcd Sep 8, 2025 •

edited

Loading