You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Azure Synapse Data Explorer offers ingestion (data loading) from Event Hubs, a big data streaming platform and event ingestion service. [Event Hubs](../../../event-hubs/event-hubs-about.md) can process millions of events per second in near real-time. In this article, you connect an Event Hub to a table in Azure Synapse Data Explorer using the [one-click ingestion](data-explorer-ingest-data-one-click.md) experience.
21
+
Azure Synapse Data Explorer offers ingestion (data loading) from Event Hubs, a big data streaming platform and event ingestion service. [Event Hubs](../../../event-hubs/event-hubs-about.md) can process millions of events per second in near real-time. In this article, you connect an Event Hubs to a table in Azure Synapse Data Explorer using the [one-select ingestion](data-explorer-ingest-data-one-click.md) experience.
-[Event Hub with data for ingestion](data-explorer-ingest-event-hub-portal.md#create-an-event-hubs).
27
+
-[Event Hubs with data for ingestion](data-explorer-ingest-event-hub-portal.md#create-an-event-hubs).
28
28
29
29
> [!NOTE]
30
30
> Ingesting data from an Event Hub into Data Explorer pools will not work if your Synapse workspace uses a managed virtual network with data exfiltration protection enabled.
@@ -39,7 +39,7 @@ Azure Synapse Data Explorer offers ingestion (data loading) from Event Hubs, a b
39
39
40
40
1. In the left menu of the Web UI, select the **Data** tab.
41
41
42
-
:::image type="content" source="../media/ingest-data-event-hub/one-click-ingestion-event-hub.png" alt-text="Select one-click ingest data from Event Hub in the web UI.":::
42
+
:::image type="content" source="../media/ingest-data-event-hub/one-click-ingestion-event-hub.png" alt-text="Select one-select ingest data from Event Hubs in the web UI.":::
43
43
44
44
1. In the **Ingest data from Event Hub** card, select **Ingest**.
45
45
@@ -64,29 +64,29 @@ The **Ingest new data** window opens with the **Destination** tab selected.
64
64
65
65
1. Under **Data Connection**, fill in the following fields:
66
66
67
-
:::image type="content" source="../media/ingest-data-one-click/select-azure-data-explorer-ingest-event-hub-details.png" alt-text="Screenshot of source tab with project details fields to be filled in - ingest new data to Azure Synapse Data Explorer with Event Hub in the one click experience.":::
67
+
:::image type="content" source="../media/ingest-data-one-click/select-azure-data-explorer-ingest-event-hub-details.png" alt-text="Screenshot of source tab with project details fields to be filled in - ingest new data to Azure Synapse Data Explorer with Event Hubs in the one select experience.":::
| Data connection name | *ContosoDataConnection* | The name that identifies your data connection.
72
-
| Subscription || The subscription ID where the Event Hub resource is located. |
73
-
| Event Hub namespace || The name that identifies your namespace. |
74
-
| Event Hub|| The Event Hub you wish to use. |
75
-
| Consumer group || The consumer group defined in your Event Hub. |
76
-
| Event system properties | Select relevant properties | The [Event Hub system properties](../../../service-bus-messaging/service-bus-amqp-protocol-guide.md#message-annotations). If there are multiple records per event message, the system properties will be added to the first one. When adding system properties, [create](/azure/data-explorer/kusto/management/create-table-command?context=/azure/synapse-analytics/context/context) or [update](/azure/data-explorer/kusto/management/alter-table-command?context=/azure/synapse-analytics/context/context) table schema and [mapping](/azure/data-explorer/kusto/management/mappings?context=/azure/synapse-analytics/context/context) to include the selected properties. |
72
+
| Subscription || The subscription ID where the Event Hubs resource is located. |
73
+
| Event Hubs namespace || The name that identifies your namespace. |
74
+
| Event Hubs|| The Event Hubs you wish to use. |
75
+
| Consumer group || The consumer group defined in your Event Hubs. |
76
+
| Event system properties | Select relevant properties | The [Event Hubs system properties](../../../service-bus-messaging/service-bus-amqp-protocol-guide.md#message-annotations). If there are multiple records per event message, the system properties will be added to the first one. When adding system properties, [create](/azure/data-explorer/kusto/management/create-table-command?context=/azure/synapse-analytics/context/context) or [update](/azure/data-explorer/kusto/management/alter-table-command?context=/azure/synapse-analytics/context/context) table schema and [mapping](/azure/data-explorer/kusto/management/mappings?context=/azure/synapse-analytics/context/context) to include the selected properties. |
77
77
78
78
1. Select **Next: Schema**.
79
79
80
80
## Schema tab
81
81
82
-
Data is read from the Event Hub in form of [EventData](/dotnet/api/microsoft.servicebus.messaging.eventdata) objects. Supported formats are CSV, JSON, PSV, SCsv, SOHsv TSV, TXT, and TSVE.
82
+
Data is read from the Event Hubs in form of [EventData](/dotnet/api/microsoft.servicebus.messaging.eventdata) objects. Supported formats are CSV, JSON, PSV, SCsv, SOHsv TSV, TXT, and TSVE.
83
83
84
84
<!-- For information on schema mapping with JSON-formatted data, see [Edit the schema](one-click-ingestion-existing-table.md#edit-the-schema).
85
85
For information on schema mapping with CSV-formatted data, see [Edit the schema](one-click-ingestion-new-table.md#edit-the-schema). -->
86
86
87
-
:::image type="content" source="../media/ingest-data-event-hub/schema-tab.png" alt-text="Screenshot of schema tab in ingest new data to Azure Synapse Data Explorer with Event Hub in the one click experience.":::
87
+
:::image type="content" source="../media/ingest-data-event-hub/schema-tab.png" alt-text="Screenshot of schema tab in ingest new data to Azure Synapse Data Explorer with Event Hubs in the one select experience.":::
88
88
89
-
1. If the data you see in the preview window is not complete, you may need more data to create a table with all necessary data fields. Use the following commands to fetch new data from your Event Hub:
89
+
1. If the data you see in the preview window isn't complete, you may need more data to create a table with all necessary data fields. Use the following commands to fetch new data from your Event Hubs:
90
90
***Discard and fetch new data**: discards the data presented and searches for new events.
91
91
***Fetch more data**: Searches for more events in addition to the events already found.
92
92
@@ -95,11 +95,11 @@ For information on schema mapping with CSV-formatted data, see [Edit the schema]
95
95
96
96
1. Select **Next: Summary**.
97
97
98
-
## Continuous ingestion from Event Hub
98
+
## Continuous ingestion from Event Hubs
99
99
100
-
In the **Continuous ingestion from Event Hub established** window, all steps will be marked with green check marks when establishment finishes successfully. The cards below these steps give you options to explore your data with **Quick queries**, undo changes made using **Tools**, or **Monitor** the Event Hub connections and data.
100
+
In the **Continuous ingestion from Event Hub established** window, all steps will be marked with green check marks when establishment finishes successfully. The cards below these steps give you options to explore your data with **Quick queries**, undo changes made using **Tools**, or **Monitor** the Event Hubs connections and data.
101
101
102
-
:::image type="content" source="../media/ingest-data-event-hub/data-ingestion-completed.png" alt-text="Screenshot of final screen in ingestion to Azure Synapse Data Explorer from Event Hub with the one click experience.":::
102
+
:::image type="content" source="../media/ingest-data-event-hub/data-ingestion-completed.png" alt-text="Screenshot of final screen in ingestion to Azure Synapse Data Explorer from Event Hubs with the one select experience.":::
Copy file name to clipboardExpand all lines: articles/synapse-analytics/data-explorer/ingest-data/data-explorer-ingest-event-hub-resource-manager.md
+7-7Lines changed: 7 additions & 7 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -1,6 +1,6 @@
1
1
---
2
-
title: Create an Event Hub data connection for Azure Synapse Data Explorer by using Azure Resource Manager template (Preview)
3
-
description: In this article, you learn how to create an Event Hub data connection for Azure Synapse Data Explorer by using Azure Resource Manager template.
2
+
title: Create an Event Hubs data connection for Azure Synapse Data Explorer by using Azure Resource Manager template (Preview)
3
+
description: In this article, you learn how to create an Event Hubs data connection for Azure Synapse Data Explorer by using Azure Resource Manager template.
4
4
ms.topic: how-to
5
5
ms.date: 11/02/2021
6
6
author: shsagir
@@ -11,7 +11,7 @@ ms.subservice: data-explorer
11
11
ms.custom: devx-track-arm-template
12
12
---
13
13
14
-
# Create an Event Hub data connection for Azure Synapse Data Explorer by using Azure Resource Manager template (Preview)
14
+
# Create an Event Hubs data connection for Azure Synapse Data Explorer by using Azure Resource Manager template (Preview)
## Azure Resource Manager template for adding an Event Hub data connection
35
+
## Azure Resource Manager template for adding an Event Hubs data connection
36
36
37
-
The following example shows an Azure Resource Manager template for adding an Event Hub data connection. You can [edit and deploy the template in the Azure portal](/azure/azure-resource-manager/resource-manager-quickstart-create-templates-use-the-portal#edit-and-deploy-the-template) by using the form.
37
+
The following example shows an Azure Resource Manager template for adding an Event Hubs data connection. You can [edit and deploy the template in the Azure portal](/azure/azure-resource-manager/resource-manager-quickstart-create-templates-use-the-portal#edit-and-deploy-the-template) by using the form.
0 commit comments