Skip to content

Commit b3b4aeb

Browse files
authored
Merge pull request #102574 from kromerm/dataflow-1
Update data flow transform activities in concepts-integration-runtime.md
2 parents 294a84a + fac483b commit b3b4aeb

File tree

3 files changed

+12
-8
lines changed

3 files changed

+12
-8
lines changed

articles/data-factory/concepts-integration-runtime.md

Lines changed: 7 additions & 7 deletions
Original file line numberDiff line numberDiff line change
@@ -12,7 +12,7 @@ ms.workload: data-services
1212

1313
ms.topic: conceptual
1414
ms.custom: seo-lt-2019
15-
ms.date: 05/31/2019
15+
ms.date: 01/28/2020
1616
---
1717

1818
# Integration runtime in Azure Data Factory
@@ -137,9 +137,9 @@ When used to perform data movement, the self-hosted IR extracts data from the so
137137
### Azure-SSIS IR location
138138
Selecting the right location for your Azure-SSIS IR is essential to achieve high performance in your extract-transform-load (ETL) workflows.
139139

140-
- The location of your Azure-SSIS IR does not need be the same as the location of your data factory, but it should be the same as the location of your own Azure SQL Database/Managed Instance server where SSISDB is to be hosted. This way, your Azure-SSIS Integration Runtime can easily access SSISDB without incurring excessive traffics between different locations.
141-
- If you do not have an existing Azure SQL Database/Managed Instance server to host SSISDB, but you have on-premises data sources/destinations, you should create a new Azure SQL Database/Managed Instance server in the same location of a virtual network connected to your on-premises network. This way, you can create your Azure-SSIS IR using the new Azure SQL Database/Managed Instance server and joining that virtual network, all in the same location, effectively minimizing data movements across different locations.
142-
- If the location of your existing Azure SQL Database/Managed Instance server where SSISDB is hosted is not the same as the location of a virtual network connected to your on-premises network, first create your Azure-SSIS IR using an existing Azure SQL Database/Managed Instance server and joining another virtual network in the same location, and then configure a virtual network to virtual network connection between different locations.
140+
- The location of your Azure-SSIS IR does not need be the same as the location of your data factory, but it should be the same as the location of your own Azure SQL Database or Managed Instance server where SSISDB is to be hosted. This way, your Azure-SSIS Integration Runtime can easily access SSISDB without incurring excessive traffics between different locations.
141+
- If you do not have an existing Azure SQL Database or Managed Instance server to host SSISDB, but you have on-premises data sources/destinations, you should create a new Azure SQL Database or Managed Instance server in the same location of a virtual network connected to your on-premises network. This way, you can create your Azure-SSIS IR using the new Azure SQL Database or Managed Instance server and joining that virtual network, all in the same location, effectively minimizing data movements across different locations.
142+
- If the location of your existing Azure SQL Database or Managed Instance server where SSISDB is hosted is not the same as the location of a virtual network connected to your on-premises network, first create your Azure-SSIS IR using an existing Azure SQL Database or Managed Instance server and joining another virtual network in the same location, and then configure a virtual network to virtual network connection between different locations.
143143

144144
The following diagram shows location settings of Data Factory and its integration run times:
145145

@@ -159,13 +159,13 @@ For Copy activity, it requires source and sink linked services to define the dir
159159

160160
The Lookup and GetMetadata activity is executed on the integration runtime associated to the data store linked service.
161161

162-
### Transformation activity
162+
### External transformation activity
163163

164-
Each transformation activity has a target compute Linked Service, which points to an integration runtime. This integration runtime instance is where the transformation activity is dispatched from.
164+
Each external transformation activity that utilizes an external compute engine has a target compute Linked Service, which points to an integration runtime. This integration runtime instance determines the location where that external hand-coded transformation activity is dispatched from.
165165

166166
### Data Flow activity
167167

168-
Data Flow activity is executed on the integration runtime associated to it.
168+
Data Flow activities are executed on the Azure integration runtime associated to it. The Spark compute utilized by Data Flows are determined by the data flow properties in your Azure Integration Runtime and are fully managed by ADF.
169169

170170
## Next steps
171171
See the following articles:

articles/data-factory/connector-azure-sql-database.md

Lines changed: 5 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -10,7 +10,7 @@ ms.service: data-factory
1010
ms.workload: data-services
1111
ms.topic: conceptual
1212
ms.custom: seo-lt-2019
13-
ms.date: 12/13/2019
13+
ms.date: 01/28/2020
1414
---
1515

1616
# Copy and transform data in Azure SQL Database by using Azure Data Factory
@@ -585,6 +585,10 @@ Settings specific to Azure SQL Database are available in the **Settings** tab of
585585

586586
**Update method:** Determines what operations are allowed on your database destination. The default is to only allow inserts. To update, upsert, or delete rows, an alter-row transformation is required to tag rows for those actions. For updates, upserts and deletes, a key column or columns must be set to determine which row to alter.
587587

588+
![Key Columns](media/data-flow/keycolumn.png "Key Columns")
589+
590+
The column name that you pick as the key here will be used by ADF as part of the subsequent update, upsert, delete. Therefore, you must pick a column that exists in the Sink mapping. If you wish to not write the value to this key column, then click "Skip writing key columns".
591+
588592
**Table action:** Determines whether to recreate or remove all rows from the destination table prior to writing.
589593
* None: No action will be done to the table.
590594
* Recreate: The table will get dropped and recreated. Required if creating a new table dynamically.
17.9 KB
Loading

0 commit comments

Comments
 (0)