Commit 563f4a7
committed
[SPARK-53910] Add
### What changes were proposed in this pull request?
This PR aims to add `StatefulSet`-based SparkApp example.
### Why are the changes needed?
To provide a `StatefulSet` example with `spark.kubernetes.allocation.pods.allocator=statefulset`.
Note that this requires the following is a part of `v0.6.0`.
- #389
### Does this PR introduce _any_ user-facing change?
No, this is a new example.
### How was this patch tested?
Manual review.
```
$ kubectl apply -f examples/pi-statefulset.yaml
sparkapplication.spark.apache.org/pi-statefulset created
```
```
$ kubectl get sparkapp
NAME CURRENT STATE AGE
pi-statefulset RunningHealthy 5s
```
```
$ kubectl get pod
NAME READY STATUS RESTARTS AGE
pi-statefulset-0-driver 1/1 Running 0 7s
spark-kubernetes-operator-cdb4b547d-5bhfm 1/1 Running 0 80s
spark-s-pi-statefulset-0-0-0 1/1 Running 0 5s
spark-s-pi-statefulset-0-0-1 1/1 Running 0 5s
spark-s-pi-statefulset-0-0-2 1/1 Running 0 5s
```
```
$ kubectl get sparkapp
NAME CURRENT STATE AGE
pi-statefulset ResourceReleased 48s
```
### Was this patch authored or co-authored using generative AI tooling?
No.
Closes #390 from dongjoon-hyun/SPARK-53910.
Authored-by: Dongjoon Hyun <[email protected]>
Signed-off-by: Dongjoon Hyun <[email protected]>StatefulSet-based SparkApp example1 parent 55a1905 commit 563f4a7
1 file changed
+31
-0
lines changed| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
| 1 | + | |
| 2 | + | |
| 3 | + | |
| 4 | + | |
| 5 | + | |
| 6 | + | |
| 7 | + | |
| 8 | + | |
| 9 | + | |
| 10 | + | |
| 11 | + | |
| 12 | + | |
| 13 | + | |
| 14 | + | |
| 15 | + | |
| 16 | + | |
| 17 | + | |
| 18 | + | |
| 19 | + | |
| 20 | + | |
| 21 | + | |
| 22 | + | |
| 23 | + | |
| 24 | + | |
| 25 | + | |
| 26 | + | |
| 27 | + | |
| 28 | + | |
| 29 | + | |
| 30 | + | |
| 31 | + | |
0 commit comments