Skip to content

Conversation

kimoonkim
Copy link
Member

The step is not necessary as the upstream make-distribution.sh now puts Dockerfiles in the tarball. Also changes SparkDockerImageBuilder to use new Dockerfiles paths.

The change is tested manually.

$ mvn clean integration-test -Dspark-distro-tgz=~/Tmp/spark-2.3.0-SNAPSHOT-bin-20171222-13190a4f60.tgz

cc @foxish

@foxish
Copy link
Member

foxish commented Dec 22, 2017

LGTM!

@kimoonkim
Copy link
Member Author

Once merged, I can adjust the jenkins setup to remove copy-artifact step for copying Dockerfiles between the two build jobs.

@foxish foxish merged commit b3583fb into apache-spark-on-k8s:master Dec 22, 2017
@kimoonkim
Copy link
Member Author

Just adjusted the Jenkins setup and ran a new build successfully.

@kimoonkim kimoonkim deleted the kill-copy-dockerfile-step branch December 22, 2017 20:12
@foxish
Copy link
Member

foxish commented Dec 22, 2017

Great! Can we have it post run status also on apache-spark-on-k8s/spark#582?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants