Skip to content

fix(datascience): enable Arrow S3 and Substrait support in pyarrow build

d723927
Select commit
Loading
Failed to load commit list.
Open

[2.25.1] Cherry-pick: fix PyArrow dependency resolution in Data Science image for RHOAI 2.25 #1655

fix(datascience): enable Arrow S3 and Substrait support in pyarrow build
d723927
Select commit
Loading
Failed to load commit list.
Konflux Internal p02 / Konflux Production Internal / odh-workbench-jupyter-datascience-cpu-py312-on-pull-request failed Dec 1, 2025 in 2h 0m 3s

Failed

Konflux Production Internal/odh-workbench-jupyter-datascience-cpu-py312-on-pull-request has failed.

Details


Task Statuses:

StatusDurationName
🟢 Succeeded 6 seconds

rhoai-init

🟢 Succeeded 6 seconds

init

🟢 Succeeded 15 seconds

clone-repository

🟢 Succeeded 9 seconds

prefetch-dependencies

🔴 Failed 1 hour

build-images

🟢 Succeeded 27 minutes

build-images

🟢 Succeeded 17 minutes

build-images

🔴 Failed 7 minutes

build-images


Failure snippet:

task build-images has the status "Failed":
subprocess exited with status 2
subprocess exited with status 2
Error: building at STEP "RUN --mount=type=cache,target=/root/.cache/pip --mount=type=cache,target=/root/.cache/dnf if [ "$TARGETARCH" = "ppc64le" ] || [ "$TARGETARCH" = "s390x" ]; then         dnf install -y cmake make gcc-c++ pybind11-devel wget &&         dnf clean all &&         git clone --depth 1 --branch "apache-arrow-17.0.0" https://github.com/apache/arrow.git &&         cd arrow/cpp &&         mkdir release && cd release &&         cmake -DCMAKE_BUILD_TYPE=Release               -DCMAKE_INSTALL_PREFIX=/usr/local               -DARROW_PYTHON=ON               -DARROW_PARQUET=ON               -DARROW_ORC=ON               -DARROW_FILESYSTEM=ON               -DARROW_JSON=ON               -DARROW_CSV=ON               -DARROW_DATASET=ON               -DARROW_DEPENDENCY_SOURCE=BUNDLED               -DARROW_WITH_LZ4=OFF               -DARROW_WITH_ZSTD=OFF               -DARROW_WITH_SNAPPY=OFF               -DARROW_S3=ON               -DARROW_SUBSTRAIT=ON               -DARROW_BUILD_TESTS=OFF               -DARROW_BUILD_BENCHMARKS=OFF               .. &&         make -j$(nproc) VERBOSE=1 &&         make install -j$(nproc) &&         cd ../../python &&         pip install --no-cache-dir -r requirements-build.txt &&         PYARROW_WITH_PARQUET=1         PYARROW_WITH_DATASET=1         PYARROW_WITH_FILESYSTEM=1         PYARROW_WITH_JSON=1         PYARROW_WITH_CSV=1         PYARROW_PARALLEL=$(nproc)         python setup.py build_ext --build-type=release --bundle-arrow-cpp bdist_wheel &&         mkdir -p /tmp/wheels &&         cp dist/pyarrow-*.whl /tmp/wheels/ &&         chmod -R 777 /tmp/wheels &&         ls -la /tmp/wheels/;     else         mkdir -p /tmp/wheels;     fi": exit status 2