Skip to content

Commit 904201c

Browse files
authored
Update concepts-data-flow-performance.md
1 parent 5765cc8 commit 904201c

File tree

1 file changed

+2
-2
lines changed

1 file changed

+2
-2
lines changed

articles/data-factory/concepts-data-flow-performance.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -64,15 +64,15 @@ By default, turning on debug will use the default Azure Integration runtime that
6464

6565
Under **Source Options** in the source transformation, the following settings can affect performance:
6666

67-
* Batch size instructs ADF to store data in sets in memory instead of row-by-row. Batch size is an optional setting and you may run out of resources on the compute nodes if they aren't sized properly.
67+
* Batch size instructs ADF to store data in sets in Spark memory instead of row-by-row. Batch size is an optional setting and you may run out of resources on the compute nodes if they aren't sized properly. Not setting this property will utilize Spark caching batch defaults.
6868
* Setting a query can allow you to filter rows at the source before they arrive in Data Flow for processing. This can make the initial data acquisition faster. If you use a query, you can add optional query hints for your Azure SQL DB such as READ UNCOMMITTED.
6969
* Read uncommitted will provide faster query results on Source transformation
7070

7171
![Source](media/data-flow/source4.png "Source")
7272

7373
### Sink batch size
7474

75-
To avoid row-by-row processing of your data flows, set **Batch size** in the Settings tab for Azure SQL DB and Azure SQL DW sinks. If batch size is set, ADF processes database writes in batches based on the size provided.
75+
To avoid row-by-row processing of your data flows, set **Batch size** in the Settings tab for Azure SQL DB and Azure SQL DW sinks. If batch size is set, ADF processes database writes in batches based on the size provided. Not setting this property will utilize Spark caching batch defaults.
7676

7777
![Sink](media/data-flow/sink4.png "Sink")
7878

0 commit comments

Comments
 (0)