Skip to content

Commit 99c96f2

Browse files
committed
[SPARK-53740] Update (pi|spark-history-server)-preview.yaml to use 4.1.0-preview2
### What changes were proposed in this pull request? This PR aims to update two examples to use `4.1.0-preview2`. - `pi-preview.yaml` - `spark-history-server-preview.yaml` ### Why are the changes needed? To help the users access the latest preview version features more easily. ### Does this PR introduce _any_ user-facing change? No behavior change because this is an example update. ### How was this patch tested? Manually. Since 4.1.0-preview2 image is not published yet, I built the image locally and used it. ``` $ ./bin/docker-image-tool.sh -r docker.io/apache -t 4.1.0-preview2-java21-scala build ``` ### Was this patch authored or co-authored using generative AI tooling? No. Closes #354 from dongjoon-hyun/SPARK-53740. Authored-by: Dongjoon Hyun <[email protected]> Signed-off-by: Dongjoon Hyun <[email protected]>
1 parent 2ba8722 commit 99c96f2

File tree

2 files changed

+5
-5
lines changed

2 files changed

+5
-5
lines changed

examples/pi-preview.yaml

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -24,8 +24,8 @@ spec:
2424
spark.dynamicAllocation.shuffleTracking.enabled: "true"
2525
spark.dynamicAllocation.maxExecutors: "3"
2626
spark.kubernetes.authenticate.driver.serviceAccountName: "spark"
27-
spark.kubernetes.container.image: "apache/spark:4.1.0-preview1-java21-scala"
27+
spark.kubernetes.container.image: "apache/spark:4.1.0-preview2-java21-scala"
2828
applicationTolerations:
2929
resourceRetainPolicy: OnFailure
3030
runtimeVersions:
31-
sparkVersion: "4.1.0-preview1"
31+
sparkVersion: "4.1.0-preview2"

examples/spark-history-server-preview.yaml

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -19,11 +19,11 @@ metadata:
1919
spec:
2020
mainClass: "org.apache.spark.deploy.history.HistoryServer"
2121
sparkConf:
22-
spark.jars.packages: "org.apache.hadoop:hadoop-aws:3.4.1"
22+
spark.jars.packages: "org.apache.hadoop:hadoop-aws:3.4.2"
2323
spark.jars.ivy: "/tmp/.ivy2.5.2"
2424
spark.driver.memory: "2g"
2525
spark.kubernetes.authenticate.driver.serviceAccountName: "spark"
26-
spark.kubernetes.container.image: "apache/spark:4.1.0-preview1-java21-scala"
26+
spark.kubernetes.container.image: "apache/spark:4.1.0-preview2-java21-scala"
2727
spark.ui.port: "18080"
2828
spark.history.fs.logDirectory: "s3a://spark-events"
2929
spark.history.fs.cleaner.enabled: "true"
@@ -36,7 +36,7 @@ spec:
3636
spark.hadoop.fs.s3a.access.key: "test"
3737
spark.hadoop.fs.s3a.secret.key: "test"
3838
runtimeVersions:
39-
sparkVersion: "4.1.0-preview1"
39+
sparkVersion: "4.1.0-preview2"
4040
applicationTolerations:
4141
restartConfig:
4242
restartPolicy: Always

0 commit comments

Comments
 (0)