Skip to content

Commit 51c6083

Browse files
committed
[SPARK-52676] Use Java 21 for SparkApp benchmark
### What changes were proposed in this pull request? This PR aims to use Java 21 for `SparkApp` benchmark. ### Why are the changes needed? **BEFORE** ``` $ docker run -it --rm apache/spark:4.0.0 java --version openjdk 17.0.15 2025-04-15 OpenJDK Runtime Environment Temurin-17.0.15+6 (build 17.0.15+6) ``` **AFTER** ``` $ docker run -it --rm apache/spark:4.0.0-java21-scala java --version openjdk 21.0.7 2025-04-15 LTS OpenJDK Runtime Environment Temurin-21.0.7+6 (build 21.0.7+6-LTS) OpenJDK 64-Bit Server VM Temurin-21.0.7+6 (build 21.0.7+6-LTS, mixed mode, sharing) ``` In addition, this PR uses the smaller image because we don't need Python. ``` $ docker images | grep apache/spark apache/spark 4.0.0 d25d55f20f67 9 days ago 1.25GB apache/spark 4.0.0-java21-scala 94b89e5b436d 9 days ago 977MB ``` ### Does this PR introduce _any_ user-facing change? No, this is a test change. ### How was this patch tested? Manual review. ### Was this patch authored or co-authored using generative AI tooling? No. Closes apache#277 from dongjoon-hyun/SPARK-52676. Authored-by: Dongjoon Hyun <[email protected]> Signed-off-by: Dongjoon Hyun <[email protected]>
1 parent a81a923 commit 51c6083

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

tests/benchmark/sparkapps.sh

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -42,7 +42,7 @@ spec:
4242
spark.kubernetes.driver.request.memory: "100Mi"
4343
spark.kubernetes.driver.master: "local[1]"
4444
spark.kubernetes.authenticate.driver.serviceAccountName: "spark"
45-
spark.kubernetes.container.image: "apache/spark:4.0.0"
45+
spark.kubernetes.container.image: "apache/spark:4.0.0-java21-scala"
4646
runtimeVersions:
4747
sparkVersion: "4.0.0"
4848
---

0 commit comments

Comments
 (0)