Skip to content

Commit 2180dde

Browse files
Merge pull request #97806 from LiliamLeme/patch-5
Update apache-spark-autoscale.md
2 parents c6d5933 + 5497aaa commit 2180dde

File tree

1 file changed

+6
-1
lines changed

1 file changed

+6
-1
lines changed

articles/synapse-analytics/spark/apache-spark-autoscale.md

Lines changed: 6 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -74,7 +74,12 @@ Apache Spark enables configuration of Dynamic Allocation of Executors through co
7474
```
7575
The defaults specified through the code override the values set through the user interface.
7676

77-
On enabling Dynamic allocation, Executors scale up or down based on the utilization of the Executors. This ensure that the Executors are provisioned in accordance with the needs of the job being run.
77+
In this example, if your job requires only 2 executors, it will use only 2 executors. When the job requires more, it will scale up to 6 executors (1 driver, 6 executors). When the job doesn't need the executors, then it will decommission the executors. If it doesn't need the node, it will free up the node.
78+
79+
>[!NOTE]
80+
>The maxExecutors will reserve the number of executors configured. Considering the example, even if you use only 2, it will reserve 6.
81+
82+
Hence, on enabling Dynamic allocation, Executors scale up or down based on the utilization of the Executors. This ensures that the Executors are provisioned in accordance with the needs of the job being run.
7883

7984
## Best practices
8085

0 commit comments

Comments
 (0)