You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
[SPARK-53827] Exclude commons-(codec|compress) and com.ibm.icu transitive dependencies
### What changes were proposed in this pull request?
This PR aims to exclude 3 transitive dependencies to reduce the size of `spark-kubernetes-operator.jar` about **11% (from 149MB to 133MB)**.
- `commons-codec:*`
- `org.apache.commons:commons-compress`
- `com.ibm.icu:*`
### Why are the changes needed?
Apache Spark K8s Operator is not using these. We had better remove this to reduce `spark-kubernetes-operator.jar` file size (and the Docker image size) from 149MB to 133MB.
**BEFORE**
```
$ docker run -it --rm apache/spark-kubernetes-operator:0.6.0-SNAPSHOT ls -alh /opt/spark-operator/operator | tail -n1
/
-rw-r--r-- 1 spark spark 149M Oct 7 23:21 spark-kubernetes-operator.jar
```
**AFTER**
```
$ docker run -it --rm apache/spark-kubernetes-operator:0.6.0-SNAPSHOT ls -alh /opt/spark-operator/operator | tail -n1
/
-rw-r--r-- 1 spark spark 133M Oct 7 23:28 spark-kubernetes-operator.jar
```
### Does this PR introduce _any_ user-facing change?
No behavior change.
### How was this patch tested?
Pass the CIs.
### Was this patch authored or co-authored using generative AI tooling?
No.
Closesapache#375 from dongjoon-hyun/SPARK-53827.
Authored-by: Dongjoon Hyun <[email protected]>
Signed-off-by: Dongjoon Hyun <[email protected]>
0 commit comments