You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/data-factory/frequently-asked-questions.md
+21-22Lines changed: 21 additions & 22 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -27,19 +27,19 @@ To support the diverse integration flows and patterns in the modern data warehou
27
27
Data Factory provides freedom to model any flow style that's required for data integration and that can be dispatched on demand or repeatedly on a schedule. A few common flows that this model enables are:
28
28
29
29
- Control flows:
30
-
- Activities can be chained together in a sequence within a pipeline.
31
-
- Activities can be branched within a pipeline.
32
-
- Parameters:
33
-
- Parameters can be defined at the pipeline level and arguments can be passed while you invoke the pipeline on demand or from a trigger.
34
-
- Activities can consume the arguments that are passed to the pipeline.
35
-
- Custom state passing:
36
-
- Activity outputs, including state, can be consumed by a subsequent activity in the pipeline.
37
-
- Looping containers:
38
-
- The foreach activity will iterate over a specified collection of activities in a loop.
30
+
- Activities can be chained together in a sequence within a pipeline.
31
+
- Activities can be branched within a pipeline.
32
+
- Parameters:
33
+
- Parameters can be defined at the pipeline level and arguments can be passed while you invoke the pipeline on demand or from a trigger.
34
+
- Activities can consume the arguments that are passed to the pipeline.
35
+
- Custom state passing:
36
+
- Activity outputs, including state, can be consumed by a subsequent activity in the pipeline.
37
+
- Looping containers:
38
+
- The foreach activity will iterate over a specified collection of activities in a loop.
39
39
- Trigger-based flows:
40
-
- Pipelines can be triggered on demand or by wall-clock time.
40
+
- Pipelines can be triggered on demand or by wall-clock time.
41
41
- Delta flows:
42
-
- Parameters can be used to define your high-water mark for delta copy while moving dimension or reference tables from a relational store, either on-premises or in the cloud, to load the data into the lake.
42
+
- Parameters can be used to define your high-water mark for delta copy while moving dimension or reference tables from a relational store, either on-premises or in the cloud, to load the data into the lake.
43
43
44
44
For more information, see [Tutorial: Control flows](tutorial-control-flow.md).
45
45
@@ -73,15 +73,15 @@ You can monitor your Data Factories via PowerShell, SDK, or the Visual Monitorin
73
73
### New features for SSIS in Data Factory
74
74
Since the initial public preview release in 2017, Data Factory has added the following features for SSIS:
75
75
76
-
-Support for three more configurations/variants of Azure SQL Database to host the SSIS database (SSISDB) of projects/packages:
77
-
-SQL Database with virtual network service endpoints
78
-
-Managed instance
79
-
-Elastic pool
80
-
-Support for an Azure Resource Manager virtual network on top of a classic virtual network to be deprecated in the future, which lets you inject/join your Azure-SSIS integration runtime to a virtual network configured for SQL Database with virtual network service endpoints/MI/on-premises data access. For more information, see also [Join an Azure-SSIS integration runtime to a virtual network](join-azure-ssis-integration-runtime-virtual-network.md).
81
-
-Support for Azure Active Directory (Azure AD) authentication and SQL authentication to connect to the SSISDB, allowing Azure AD authentication with your Data Factory managed identity for Azure resources
82
-
-Support for bringing your own on-premises SQL Server license to earn substantial cost savings from the Azure Hybrid Benefit option
83
-
-Support for Enterprise Edition of the Azure-SSIS integration runtime that lets you use advanced/premium features, a custom setup interface to install additional components/extensions, and a partner ecosystem. For more information, see also [Enterprise Edition, Custom Setup, and 3rd Party Extensibility for SSIS in ADF](https://blogs.msdn.microsoft.com/ssis/2018/04/27/enterprise-edition-custom-setup-and-3rd-party-extensibility-for-ssis-in-adf/).
84
-
-Deeper integration of SSIS in Data Factory that lets you invoke/trigger first-class Execute SSIS Package activities in Data Factory pipelines and schedule them via SSMS. For more information, see also [Modernize and extend your ETL/ELT workflows with SSIS activities in ADF pipelines](https://blogs.msdn.microsoft.com/ssis/2018/05/23/modernize-and-extend-your-etlelt-workflows-with-ssis-activities-in-adf-pipelines/).
76
+
-Support for three more configurations/variants of Azure SQL Database to host the SSIS database (SSISDB) of projects/packages:
77
+
-SQL Database with virtual network service endpoints
78
+
-Managed instance
79
+
-Elastic pool
80
+
-Support for an Azure Resource Manager virtual network on top of a classic virtual network to be deprecated in the future, which lets you inject/join your Azure-SSIS integration runtime to a virtual network configured for SQL Database with virtual network service endpoints/MI/on-premises data access. For more information, see also [Join an Azure-SSIS integration runtime to a virtual network](join-azure-ssis-integration-runtime-virtual-network.md).
81
+
-Support for Azure Active Directory (Azure AD) authentication and SQL authentication to connect to the SSISDB, allowing Azure AD authentication with your Data Factory managed identity for Azure resources
82
+
-Support for bringing your own on-premises SQL Server license to earn substantial cost savings from the Azure Hybrid Benefit option
83
+
-Support for Enterprise Edition of the Azure-SSIS integration runtime that lets you use advanced/premium features, a custom setup interface to install additional components/extensions, and a partner ecosystem. For more information, see also [Enterprise Edition, Custom Setup, and 3rd Party Extensibility for SSIS in ADF](https://blogs.msdn.microsoft.com/ssis/2018/04/27/enterprise-edition-custom-setup-and-3rd-party-extensibility-for-ssis-in-adf/).
84
+
-Deeper integration of SSIS in Data Factory that lets you invoke/trigger first-class Execute SSIS Package activities in Data Factory pipelines and schedule them via SSMS. For more information, see also [Modernize and extend your ETL/ELT workflows with SSIS activities in ADF pipelines](https://blogs.msdn.microsoft.com/ssis/2018/05/23/modernize-and-extend-your-etlelt-workflows-with-ssis-activities-in-adf-pipelines/).
85
85
86
86
87
87
## What is the integration runtime?
@@ -202,7 +202,6 @@ Wrangling data flow is currently supported in data factories created in followin
202
202
* Australia East
203
203
* Canada Central
204
204
* Central India
205
-
* Central US
206
205
* East US
207
206
* East US 2
208
207
* Japan East
@@ -236,7 +235,7 @@ Wrangling data flows allow you to do agile data preparation and exploration usin
236
235
237
236
Power Platform Dataflows allow users to import and transform data from a wide range of data sources into the Common Data Service and Azure Data Lake to build PowerApps applications, Power BI reports or Flow automations. Power Platform Dataflows use the established Power Query data preparation experiences, similar to Power BI and Excel. Power Platform Dataflows also enable easy reuse within an organization and automatically handle orchestration (e.g. automatically refreshing dataflows that depend on another dataflow when the former one is refreshed).
238
237
239
-
Azure Data Factory (ADF) is a managed data integration service that allows data engineers and citizen data integrator to create complex hybrid extract-transform-load (ETL) and extract-load-transform (ELT) workflows. Wrangling data flow in ADF empowers users with a code-free, serverless environment that simplifies data preparation in the cloud and scales to any data size with no infrastructure management required. It uses the Power Query data preparation technology (also used in Power Platform dataflows, Excel, Power BI) to prepare and shape the data. Built to handle all the complexities and scale challenges of big data integration, wrangling data flows allow users to quickly prepare data at scale via spark execution. Users can build resilient data pipelines in an accessible visual environment with our browser-based interface and let ADF handle the complexities of Spark execution. Build schedules for your pipelines and monitor your data flow executions from the ADF monitoring portal. Easily manage data availability SLAs with ADF’s rich availability monitoring and alerts and leverage built-in continuous integration and deployment capabilities to save and manage your flows in a managed environment. Establish alerts and view execution plans to validate that your logic is performing as planned as you tune your data flows.
238
+
Azure Data Factory (ADF) is a managed data integration service that allows data engineers and citizen data integrator to create complex hybrid extract-transform-load (ETL) and extract-load-transform (ELT) workflows. Wrangling data flow in ADF empowers users with a code-free, serverless environment that simplifies data preparation in the cloud and scales to any data size with no infrastructure management required. It uses the Power Query data preparation technology (also used in Power Platform dataflows, Excel, Power BI) to prepare and shape the data. Built to handle all the complexities and scale challenges of big data integration, wrangling data flows allow users to quickly prepare data at scale via spark execution. Users can build resilient data pipelines in an accessible visual environment with our browser-based interface and let ADF handle the complexities of Spark execution. Build schedules for your pipelines and monitor your data flow executions from the ADF monitoring portal. Easily manage data availability SLAs with ADF's rich availability monitoring and alerts and leverage built-in continuous integration and deployment capabilities to save and manage your flows in a managed environment. Establish alerts and view execution plans to validate that your logic is performing as planned as you tune your data flows.
0 commit comments