0.3.0
Apache Spark™ K8s Operator is a subproject of Apache Spark and aims to extend K8s resource manager to manage Apache Spark applications via Operator Pattern. This release includes Apache Spark K8s Operator 0.3.0 (App Version) with Helm chart 1.1.0 (Chart Version).
Notable Features
- Support K8s v1.30, v1.31, v1.32, and v1.33
- Support Apache Spark 3.5 and 4.0
- Support
SparkAppandSparkClusterCRDssparkapplications.spark.apache.org(v1beta1)sparkclusters.spark.apache.org(v1beta1)
- Support
HPAforSparkCluster - Support
Artifact Hub - Provide various examples
Docker Image
docker pull apache/spark-kubernetes-operator:0.3.0
Install Helm Chart
$ helm repo add spark https://apache.github.io/spark-kubernetes-operator
$ helm repo update
$ helm install spark spark-kubernetes-operator/spark-kubernetes-operator
$ helm list
NAME NAMESPACE REVISION UPDATED STATUS CHART APP VERSION
spark default 1 2025-06-04 11:06:24.61408 -0700 PDT deployed spark-kubernetes-operator-1.1.0 0.3.0
Full Changelog:
Resolved Issues
- [SPARK-52205] Release Spark Kubernetes Operator 0.3.0 (v1beta1)
- [SPARK-51953] Support Java 24
- [SPARK-52005] Upgrade Spark build dependency to 4.0.0
- [SPARK-52207] Bump version to 0.3.0-SNAPSHOT in
mainbranch - [SPARK-52208] Add
branch-0.2topublish_snapshot_*.ymlGitHub Action jobs - [SPARK-52222] Upgrade
kubernetes-clientto 7.3.0 - [SPARK-52250] Promote Spark CRDs to
v1beta1 - [SPARK-52253] Support both
v1alpha1andv1beta1 - [SPARK-52273] Use Apache Spark 4.0.0 docker image instead of 4.0.0-preview2
- [SPARK-52279] Make
spark-kubernetes-operatorget the official status inArtifact Hub - [SPARK-52291] Remove
nightlyinfo fromREADME.md - [SPARK-52292] Use
super-linterfor markdown files - [SPARK-52295] Add
pi-v1alpha1.yamlexample - [SPARK-52296] Add
spark-role=operatorlabel - [SPARK-52297] Add
Swift-basedSparkPiK8s Job example - [SPARK-52304] Add
pi-with-driver-timeout.yamlexample - [SPARK-52315] Upgrade kubernetes-client version to 7.3.1
- [SPARK-52328] Use
apache/spark-connect-swift:piimage - [SPARK-52342] Upgrade Spark 3 tests to use 3.5.6
- [SPARK-52357] Upgrade
Gradleto8.14.1 - [SPARK-52380] Update GitHub Action YAML file in
branch-0.3