Skip to content

Commit 042eb07

Browse files
committed
[SPARK-54245][INFRA] Install mlflow at Python 3.14 Docker image
### What changes were proposed in this pull request? This PR aims to install `mlflow` at Python 3.14 Docker image. ### Why are the changes needed? MLFlow 3.6.0 is released with Python 3.14 support via PyArrow 22.0.0. - https://pypi.org/project/mlflow/3.6.0/ Like the other images, we will add the same condition `mlflow>=2.8.1`, but it will install `MLFlow>=3.6.0` effectively. https://github.com/apache/spark/blob/a871ba4464e07cb0229b1289b125bb07da7b6265/dev/spark-test-image/python-313/Dockerfile#L71 ### Does this PR introduce _any_ user-facing change? No behavior change. ### How was this patch tested? Manual review. ### Was this patch authored or co-authored using generative AI tooling? No. Closes #52948 from dongjoon-hyun/SPARK-54245. Authored-by: Dongjoon Hyun <[email protected]> Signed-off-by: Dongjoon Hyun <[email protected]> (cherry picked from commit d16b128) Signed-off-by: Dongjoon Hyun <[email protected]>
1 parent 750621e commit 042eb07

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

dev/spark-test-image/python-314/Dockerfile

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -68,7 +68,7 @@ RUN apt-get update && apt-get install -y \
6868
&& rm -rf /var/lib/apt/lists/*
6969

7070

71-
ARG BASIC_PIP_PKGS="numpy pyarrow>=22.0.0 six==1.16.0 pandas==2.3.3 scipy plotly<6.0.0 coverage matplotlib openpyxl memory-profiler>=0.61.0 scikit-learn>=1.3.2"
71+
ARG BASIC_PIP_PKGS="numpy pyarrow>=22.0.0 six==1.16.0 pandas==2.3.3 scipy plotly<6.0.0 mlflow>=2.8.1 coverage matplotlib openpyxl memory-profiler>=0.61.0 scikit-learn>=1.3.2"
7272
# Python deps for Spark Connect
7373
ARG CONNECT_PIP_PKGS="grpcio==1.76.0 grpcio-status==1.76.0 protobuf==6.33.0 googleapis-common-protos==1.71.0 graphviz==0.20.3"
7474

0 commit comments

Comments
 (0)