Skip to content

Commit 926e049

Browse files
authored
Merge pull request #120681 from santhoshravindran7/patch-2
Update apache-spark-autoscale.md
2 parents e982f5c + 12d3895 commit 926e049

File tree

1 file changed

+5
-2
lines changed

1 file changed

+5
-2
lines changed

articles/synapse-analytics/spark/apache-spark-autoscale.md

Lines changed: 5 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -1,12 +1,12 @@
11
---
22
title: Automatically scale Apache Spark instances
3-
description: Use the Azure Synapse autoscale feature to automatically scale Apache Spark Instances
3+
description: Use the Azure Synapse Analytics autoscale feature to automatically scale Apache Spark Pools
44
author: guyhay
55
ms.author: guyhay
66
ms.service: synapse-analytics
77
ms.topic: conceptual
88
ms.subservice: spark
9-
ms.date: 02/14/2023
9+
ms.date: 03/11/2024
1010
---
1111

1212
# Automatically scale Azure Synapse Analytics Apache Spark pools
@@ -94,6 +94,9 @@ During the instance scaling down process, Autoscale will put the nodes in decomm
9494

9595
The running jobs will continue to run and finish. The pending jobs will wait to be scheduled as normal with fewer available nodes.
9696

97+
> [!NOTE]
98+
> By default, spark.yarn.executor.decommission.enabled is set to true, enabling the automatic shutdown of underutilized nodes to optimize compute efficiency. If less aggressive scaling down is preferred, this configuration can be set to false.
99+
97100
## Next steps
98101

99102
Quickstart to set up a new Spark pool [Create a Spark pool](../quickstart-create-apache-spark-pool-portal.md)

0 commit comments

Comments
 (0)