Skip to content

Fix: spark-k8s reduce image size #1042

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 6 commits into from
Mar 28, 2025
Merged

Fix: spark-k8s reduce image size #1042

merged 6 commits into from
Mar 28, 2025

Conversation

@maltesander
Copy link
Member

@maltesander maltesander commented Mar 27, 2025

Description

part of #961

  • Does remove the recursive chmod/chown in the final image and attempts non recursive chmod/chown or doing as much as possible in the builder step.
  • removed log4shell check
  • removed patches from final image
REPOSITORY                              TAG                                   IMAGE ID       CREATED              SIZE
oci.stackable.tech/sdp/spark-k8s        3.5.5-stackable25.3.0-reduced-size    b7343e448bbc   About a minute ago   1.64GB
oci.stackable.tech/sdp/spark-k8s        3.5.5-stackable25.3.0                 c09da49b3bfb   2 days ago           2GB

@maltesander maltesander self-assigned this Mar 27, 2025
@maltesander maltesander mentioned this pull request Mar 27, 2025
Closed
@maltesander maltesander marked this pull request as ready for review March 27, 2025 15:19
@maltesander maltesander moved this to Development: Waiting for Review in Stackable Engineering Mar 27, 2025
razvan
razvan reviewed Mar 28, 2025
View reviewed changes
@maltesander maltesander requested a review from razvan March 28, 2025 12:37
razvan
razvan approved these changes Mar 28, 2025
View reviewed changes
Copy link
Member

@razvan razvan left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm!

@maltesander maltesander added this pull request to the merge queue Mar 28, 2025
@maltesander maltesander moved this from Development: Waiting for Review to Development: Done in Stackable Engineering Mar 28, 2025
Merged via the queue into main with commit 8c113ac Mar 28, 2025
3 checks passed
@maltesander maltesander deleted the fix/spark-k8s-reduce-image-size branch March 28, 2025 13:19
@lfrancke lfrancke moved this from Development: Done to Done in Stackable Engineering Mar 31, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@razvan razvan razvan approved these changes

Assignees

@maltesander maltesander

Labels

release/25.7.0

Projects

Stackable Engineering
Archived in project

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

4 participants

@maltesander @razvan @lfrancke