Skip to content

Commit bc14353

Browse files
Update apache-spark-performance.md
1 parent 4012655 commit bc14353

File tree

1 file changed

+2
-0
lines changed

1 file changed

+2
-0
lines changed

articles/synapse-analytics/spark/apache-spark-performance.md

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -59,8 +59,10 @@ Spark operates by placing data in memory, so managing memory resources is a key
5959
* Prefer smaller data partitions and account for data size, types, and distribution in your partitioning strategy.
6060
* In Synapse Spark (Runtime 3.1 or higher) you get Kryo data serialization enabled by default [Kryo data serialization](https://github.com/EsotericSoftware/kryo).
6161
* You can customize the kryoserializer buffer size using Spark configuration based on your workload requirements
62+
6263
`// Set the desired property`
6364
`spark.conf.set("spark.kryoserializer.buffer.max", "256m") `
65+
6466
* Monitor and tune Spark configuration settings.
6567

6668
For your reference, the Spark memory structure and some key executor memory parameters are shown in the next image.

0 commit comments

Comments
 (0)