Skip to content

Commit 67fd30d

Browse files
authored
Update optimize-write-for-apache-spark.md
minor change
1 parent 3e609b8 commit 67fd30d

File tree

1 file changed

+3
-4
lines changed

1 file changed

+3
-4
lines changed

articles/synapse-analytics/spark/optimize-write-for-apache-spark.md

Lines changed: 3 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -19,8 +19,7 @@ Optimize Write is a Delta Lake on Synapse feature that reduces the number of fil
1919
This feature achieves the file size by using an extra data shuffle phase over partitions, causing an extra processing cost while writing the data. The small write penalty should be outweighed by read efficiency on the tables.
2020

2121
> [!NOTE]
22-
> - Optimize write is available as a Preview feature.
23-
> - It is available on Synapse Pools for Apache Spark versions 3.1 and 3.2.
22+
> - It is available on Synapse Pools for Apache Spark versions above 3.1.
2423
2524
## Benefits of Optimize Writes
2625

@@ -48,7 +47,7 @@ This feature achieves the file size by using an extra data shuffle phase over pa
4847

4948
## How to enable and disable the optimize write feature
5049

51-
The optimize write feature is disabled by default.
50+
The optimize write feature is disabled by default. In Spark 3.3 Pool, it is enabled by default for partitioned tables.
5251

5352
Once the configuration is set for the pool or session, all Spark write patterns will use the functionality.
5453

@@ -172,4 +171,4 @@ SET `spark.microsoft.delta.optimizeWrite.binSize` = 134217728
172171
- [Use serverless Apache Spark pool in Synapse Studio](../quickstart-create-apache-spark-pool-studio.md).
173172
- [Run a Spark application in notebook](./apache-spark-development-using-notebooks.md).
174173
- [Create Apache Spark job definition in Azure Studio](./apache-spark-job-definitions.md).
175-
174+

0 commit comments

Comments
 (0)