-
Notifications
You must be signed in to change notification settings - Fork 47
[SPARK-51520][K8S] Use JRE to reduce size of Docker image #167
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[SPARK-51520][K8S] Use JRE to reduce size of Docker image #167
Conversation
7d0fd3a to
0fea1be
Compare
dongjoon-hyun
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thank you for opening a PR, @jacobsalway .
gradle/libs.versions.toml
Outdated
|
|
||
| # Packaging | ||
| shadow-jar-plugin = "8.1.1" | ||
| shadow-jar-plugin = "8.3.6" |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
The orthogonal change should be handled independently because the PR title should be the main scope of the code.
Please remove this part from this PR.
gradle/libs.versions.toml
Outdated
| spotbugs-gradle-plugin = { group = "com.github.spotbugs.snom", name = "spotbugs-gradle-plugin", version.ref = "spotbugs-plugin" } | ||
| spotless-plugin-gradle = { group = "com.diffplug.spotless", name = "spotless-plugin-gradle", version.ref = "spotless-plugin" } | ||
| shadow = { group = "com.github.johnrengelman", name = "shadow", version.ref = "shadow-jar-plugin"} | ||
| shadow = { group = "com.gradleup.shadow", name = "shadow-gradle-plugin", version.ref = "shadow-jar-plugin"} |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
ditto.
spark-operator/build.gradle
Outdated
| * under the License. | ||
| */ | ||
| apply plugin: 'com.github.johnrengelman.shadow' | ||
| apply plugin: 'com.gradleup.shadow' |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
ditto.
dongjoon-hyun
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I left a comment about the orthogonal code change part.
Signed-off-by: Jacob Salway <[email protected]>
0fea1be to
54e0fd2
Compare
Thanks for reviewing. I've removed the plugin changes and will raise a separate JIRA/PR for them. |
dongjoon-hyun
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
+1, LGTM. (Pending CIs). Thank you for updating, @jacobsalway .
|
Merged to main. Thank you again, @jacobsalway . I added you to the Apache Spark contributor group and assigned SPARK-51520 to you. Welcome to the Apache Spark community and congratulations for your first commit! |
|
Thanks @dongjoon-hyun, looking forward to hopefully contributing more in the future |
What changes were proposed in this pull request?
Why are the changes needed?
The image is currently quite large at ~500 megabytes
Does this PR introduce any user-facing change?
No
How was this patch tested?
Tested locally
Was this patch authored or co-authored using generative AI tooling?
No