You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/data-explorer/data-factory-integration.md
+5-5Lines changed: 5 additions & 5 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -12,7 +12,7 @@ ms.date: 11/14/2019
12
12
#Customer intent: I want to use Azure Data Factory to integrate with Azure Data Explorer.
13
13
---
14
14
15
-
# Azure Data Explorer integration with Azure Data Factory
15
+
# Integrate Azure Data Explorer with Azure Data Factory
16
16
17
17
[Azure Data Factory](/azure/data-factory/) (ADF) is a cloud-based data integration service that allows you to integrate different data stores and perform activities on the data. ADF allows you to create data-driven workflows for orchestrating and automating data movement and data transformation. Azure Data Explorer is one of the [supported data stores](/azure/data-factory/copy-activity-overview#supported-data-stores-and-formats) in Azure Data Factory.
18
18
@@ -36,21 +36,21 @@ In addition to the response size limit of 5,000 rows and 2 MB, the activity also
36
36
### Command activity
37
37
38
38
The Command activity allows the execution of Azure Data Explorer [control commands](/azure/kusto/concepts/#control-commands). Unlike queries, the control commands can potentially modify data or metadata. Some of the control commands are targeted to ingest data into Azure Data Explorer, using commands such as `.ingest`or `.set-or-append`) or copy data from Azure Data Explorer to external data stores using commands such as `.export`.
39
-
For a detailed walk-through of the command activity, see [use Azure Data Factory command activity to run Azure Data Explorer control commands](data-factory-command-activity.md). Using a control command to copy data can, at times, be a faster and cheaper option than the Copy activity. To determine when to use the Command activity versus the Copy activity, see [select between Copy and Command activities when copying data](#select-between-copy-and-azure-data-explorer-command-activities-when-copying-data).
39
+
For a detailed walk-through of the command activity, see [use Azure Data Factory command activity to run Azure Data Explorer control commands](data-factory-command-activity.md). Using a control command to copy data can, at times, be a faster and cheaper option than the Copy activity. To determine when to use the Command activity versus the Copy activity, see [select between Copy and Command activities when copying data](#select-between-copy-and-azure-data-explorer-command-activities-when-copy-data).
40
40
41
41
### Copy in bulk from a database template
42
42
43
43
The [Copy in bulk from a database to Azure Data Explorer by using the Azure Data Factory template](data-factory-template.md) is a predefined Azure Data Factory pipeline. The template is used to create many pipelines per database or per table for faster data copying.
44
44
45
-
## Select between Copy and Azure Data Explorer Command activities when copying data
45
+
## Select between Copy and Azure Data Explorer Command activities when copy data
46
46
47
47
This section will assist you in selecting the correct activity for your data copying needs.
48
48
49
49
When copying data from or to Azure Data Explorer, there are two available options in Azure Data Factory:
50
50
* Copy activity.
51
51
* Azure Data Explorer Command activity, which executes one of the control commands that transfer data in Azure Data Explorer.
52
52
53
-
### Copying data from Azure Data Explorer
53
+
### Copy data from Azure Data Explorer
54
54
55
55
You can copy data from Azure Data Explorer using the copy activity or the [`.export`](/azure/kusto/management/data-export/) command. The `.export` command executes a query, and then exports the results of the query.
56
56
@@ -115,7 +115,7 @@ This section addresses the use of copy activity where Azure Data Explorer is the
115
115
|**Data processing complexity**| Latency varies according to source file format, column mapping, and compression.|
116
116
|**The VM running your integration runtime**| <ul><li>For Azure copy, ADF VMs and machine SKUs can't be changed.</li><li> For on-prem to Azure copy, determine that the VM hosting your self-hosted IR is strong enough.</li></ul>|
117
117
118
-
## Monitoring activity progress
118
+
## Monitor activity progress
119
119
120
120
* When monitoring the activity progress, the *Data written* property may be much larger than the *Data read* property
121
121
because *Data read* is calculated according to the binary file size, while *Data written* is calculated according to the in-memory size, after data is de-serialized and decompressed.
0 commit comments