Skip to content

Commit 708cf16

Browse files
ifilonenkoshaneknapp
authored andcommitted
[SPARK-30111][K8S] Apt-get update to fix debian issues
### What changes were proposed in this pull request? Added apt-get update as per [docker best-practices](https://docs.docker.com/develop/develop-images/dockerfile_best-practices/#apt-get) ### Why are the changes needed? Builder is failing because: Without doing apt-get update, the APT lists get outdated and begins referring to package versions that no longer exist, hence the 404 trying to download them (Debian does not keep old versions in the archive when a package is updated). ### Does this PR introduce any user-facing change? no ### How was this patch tested? k8s builder Closes apache#26753 from ifilonenko/SPARK-30111. Authored-by: Ilan Filonenko <[email protected]> Signed-off-by: shane knapp <[email protected]>
1 parent 5496e98 commit 708cf16

File tree

2 files changed

+3
-2
lines changed

2 files changed

+3
-2
lines changed

resource-managers/kubernetes/docker/src/main/dockerfiles/spark/bindings/R/Dockerfile

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -25,7 +25,7 @@ USER 0
2525

2626
RUN mkdir ${SPARK_HOME}/R
2727

28-
RUN apt install -y r-base r-base-dev && rm -rf /var/cache/apt/*
28+
RUN apt-get update && apt install -y r-base r-base-dev && rm -rf /var/cache/apt/*
2929

3030
COPY R ${SPARK_HOME}/R
3131
ENV R_HOME /usr/lib/R

resource-managers/kubernetes/docker/src/main/dockerfiles/spark/bindings/python/Dockerfile

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -25,7 +25,8 @@ USER 0
2525

2626
RUN mkdir ${SPARK_HOME}/python
2727
# TODO: Investigate running both pip and pip3 via virtualenvs
28-
RUN apt install -y python python-pip && \
28+
RUN apt-get update && \
29+
apt install -y python python-pip && \
2930
apt install -y python3 python3-pip && \
3031
# We remove ensurepip since it adds no functionality since pip is
3132
# installed on the image and it just takes up 1.6MB on the image

0 commit comments

Comments
 (0)