[SPARK-53781] Exclude Spark's transitive dependencies consistently across modules

[dongjoon-hyun]

What changes were proposed in this pull request?

This PR aims to exclude Spark's transitive dependencies consistently across modules.

Why are the changes needed?

Currently spark-operator and spark-submission-worker modules have heterogeneous exclusion rules against Apache Spark. To be complete, we need to be consistent.

spark-kubernetes-operator/spark-operator/build.gradle

Lines 41 to 51 in 2366928

	compileOnly(libs.spark.core) {
	exclude group: "com.github.luben"
	exclude group: "io.netty", module: "netty-tcnative-boringssl-static"
	exclude group: "io.netty", module: "netty-tcnative-classes"
	exclude group: "org.apache.logging.log4j"
	exclude group: "org.fusesource.leveldbjni"
	exclude group: "org.lz4"
	exclude group: "org.rocksdb"
	exclude group: "org.slf4j"
	exclude group: "org.xerial.snappy"
	}

spark-kubernetes-operator/spark-submission-worker/build.gradle

Lines 23 to 33 in 2366928

	implementation(libs.spark.kubernetes) {
	exclude group: "io.fabric8"
	exclude group: "com.github.luben"
	exclude group: "io.netty", module: "netty-tcnative-boringssl-static"
	exclude group: "io.netty", module: "netty-tcnative-classes"
	exclude group: "org.fusesource.leveldbjni"
	exclude group: "org.lz4"
	exclude group: "org.rocksdb"
	exclude group: "org.xerial.snappy"
	exclude group: 'commons-collections', module: 'commons-collections'
	}

This PR proposes the following sorted list which is a union of the existing exclusions for both modules.

    exclude group: "com.github.luben"
    exclude group: "commons-collections", module: "commons-collections'
    exclude group: "io.fabric8"
    exclude group: "io.netty", module: "netty-tcnative-boringssl-static"
    exclude group: "io.netty", module: "netty-tcnative-classes"
    exclude group: "org.apache.logging.log4j"
    exclude group: "org.fusesource.leveldbjni"
    exclude group: "org.lz4"
    exclude group: "org.rocksdb"
    exclude group: "org.slf4j"
    exclude group: "org.xerial.snappy"

Does this PR introduce any user-facing change?

No behavior change.

How was this patch tested?

Pass the CIs.

Was this patch authored or co-authored using generative AI tooling?

No.

[dongjoon-hyun]

It seems that we need to make SLF4J dependency straight first.

[dongjoon-hyun]

After log issues were fixed and merged, this PR passes the CIs.

• [SPARK-53782] Use slf4j-api as a direct dependency #362
• [SPARK-53783] Use log4j2 instead of log4j #363

[dongjoon-hyun]

This is missed in spark-operator module.

[dongjoon-hyun]

The exclusion list is adjusted and sorted.

[dongjoon-hyun]

Could you review this PR, @peter-toth ?

[dongjoon-hyun]

Thank you, @peter-toth . Merged to main.