Commit 5d38830
committed
[SPARK-53781] Exclude Spark's transitive dependencies consistently across modules
### What changes were proposed in this pull request?
This PR aims to exclude `Spark`'s transitive dependencies consistently across modules.
### Why are the changes needed?
Currently `spark-operator` and `spark-submission-worker` modules have heterogeneous exclusion rules against Apache Spark. To be complete, we need to be consistent.
https://github.com/apache/spark-kubernetes-operator/blob/2366928e114e663d77ef0c890b59fab72a26ebc1/spark-operator/build.gradle#L41-L51
https://github.com/apache/spark-kubernetes-operator/blob/2366928e114e663d77ef0c890b59fab72a26ebc1/spark-submission-worker/build.gradle#L23-L33
This PR proposes **the following sorted list** which is a union of the existing exclusions for both modules.
```
exclude group: "com.github.luben"
exclude group: "commons-collections", module: "commons-collections'
exclude group: "io.fabric8"
exclude group: "io.netty", module: "netty-tcnative-boringssl-static"
exclude group: "io.netty", module: "netty-tcnative-classes"
exclude group: "org.apache.logging.log4j"
exclude group: "org.fusesource.leveldbjni"
exclude group: "org.lz4"
exclude group: "org.rocksdb"
exclude group: "org.slf4j"
exclude group: "org.xerial.snappy"
```
### Does this PR introduce _any_ user-facing change?
No behavior change.
### How was this patch tested?
Pass the CIs.
### Was this patch authored or co-authored using generative AI tooling?
No.
Closes #361 from dongjoon-hyun/SPARK-53781.
Authored-by: Dongjoon Hyun <[email protected]>
Signed-off-by: Dongjoon Hyun <[email protected]>1 parent 432f64a commit 5d38830
File tree
2 files changed
+9
-2
lines changed- spark-operator
- spark-submission-worker
2 files changed
+9
-2
lines changed| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
40 | 40 | | |
41 | 41 | | |
42 | 42 | | |
| 43 | + | |
43 | 44 | | |
44 | 45 | | |
45 | 46 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
19 | 19 | | |
20 | 20 | | |
21 | 21 | | |
| 22 | + | |
| 23 | + | |
| 24 | + | |
| 25 | + | |
22 | 26 | | |
23 | 27 | | |
24 | | - | |
25 | 28 | | |
| 29 | + | |
| 30 | + | |
26 | 31 | | |
27 | 32 | | |
| 33 | + | |
28 | 34 | | |
29 | 35 | | |
30 | 36 | | |
| 37 | + | |
31 | 38 | | |
32 | | - | |
33 | 39 | | |
34 | 40 | | |
35 | 41 | | |
| |||
0 commit comments