Skip to content

Commit c1d8af1

Browse files
committed
[SPARK-52654] Use ParallelGC by default
### What changes were proposed in this pull request? This PR aims to use `ParallelGC` by default. ### Why are the changes needed? Since `Spark K8s Operator` is not interactive application, we had better use `ParallelGC` because it is optimized for throughput in general. ### Does this PR introduce _any_ user-facing change? No behavior change. ### How was this patch tested? Manual review. ### Was this patch authored or co-authored using generative AI tooling? No. Closes apache#270 from dongjoon-hyun/SPARK-52654. Authored-by: Dongjoon Hyun <[email protected]> Signed-off-by: Dongjoon Hyun <[email protected]>
1 parent e0e797f commit c1d8af1

File tree

2 files changed

+2
-2
lines changed

2 files changed

+2
-2
lines changed

build-tools/helm/spark-kubernetes-operator/values.yaml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -41,7 +41,7 @@ operatorDeployment:
4141
# https://kubernetes.io/docs/concepts/scheduling-eviction/topology-spread-constraints/
4242
topologySpreadConstraints: [ ]
4343
operatorContainer:
44-
jvmArgs: "-Dfile.encoding=UTF8 -XX:+ExitOnOutOfMemoryError"
44+
jvmArgs: "-Dfile.encoding=UTF8 -XX:+ExitOnOutOfMemoryError -XX:+UseParallelGC"
4545
env:
4646
- name: "SPARK_USER"
4747
value: "spark"

docs/operations.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -76,7 +76,7 @@ following table:
7676
| operatorDeployment.operatorPod.volumes | Additional volumes to be added to the operator pod. | |
7777
| operatorDeployment.operatorPod.priorityClassName | Priority class name to be used for the operator pod | |
7878
| operatorDeployment.operatorPod.securityContext | Security context overrides for the operator pod | |
79-
| operatorDeployment.operatorPod.operatorContainer.jvmArgs | JVM arg override for the operator container. | `"-Dfile.encoding=UTF8 -XX:+ExitOnOutOfMemoryError"` |
79+
| operatorDeployment.operatorPod.operatorContainer.jvmArgs | JVM arg override for the operator container. | `"-Dfile.encoding=UTF8 -XX:+ExitOnOutOfMemoryError -XX:+UseParallelGC"` |
8080
| operatorDeployment.operatorPod.operatorContainer.env | Custom env to be added to the operator container. | |
8181
| operatorDeployment.operatorPod.operatorContainer.envFrom | Custom envFrom to be added to the operator container, e.g. for downward API. | |
8282
| operatorDeployment.operatorPod.operatorContainer.probes | Probe config for the operator container. | |

0 commit comments

Comments
 (0)