Skip to content

Commit aa5651d

Browse files
committed
[SPARK-53510] Update SparkClusterResourceSpec to use apache/spark:4.0.1 as the default value of container image
### What changes were proposed in this pull request? This PR aims to update `SparkClusterResourceSpec` to use `apache/spark:4.0.1` as the default value of container image. ### Why are the changes needed? Since Apache Spark 4.0.1 image is published, we had better use this bug fixed version. ### Does this PR introduce _any_ user-facing change? Yes if the user didn't specify the container image for Spark Cluster, but this is an expected change in that case. ### How was this patch tested? Pass the CIs. ### Was this patch authored or co-authored using generative AI tooling? No. Closes apache#311 from dongjoon-hyun/SPARK-53510. Authored-by: Dongjoon Hyun <[email protected]> Signed-off-by: Dongjoon Hyun <[email protected]>
1 parent b60a366 commit aa5651d

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

spark-submission-worker/src/main/java/org/apache/spark/k8s/operator/SparkClusterResourceSpec.java

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -59,7 +59,7 @@ public SparkClusterResourceSpec(SparkCluster cluster, SparkConf conf) {
5959
String clusterName = cluster.getMetadata().getName();
6060
String scheduler = conf.get(Config.KUBERNETES_SCHEDULER_NAME().key(), "default-scheduler");
6161
String namespace = conf.get(Config.KUBERNETES_NAMESPACE().key(), clusterNamespace);
62-
String image = conf.get(Config.CONTAINER_IMAGE().key(), "apache/spark:4.0.0");
62+
String image = conf.get(Config.CONTAINER_IMAGE().key(), "apache/spark:4.0.1");
6363
ClusterSpec spec = cluster.getSpec();
6464
String version = spec.getRuntimeVersions().getSparkVersion();
6565
StringBuilder options = new StringBuilder();

0 commit comments

Comments
 (0)