Skip to content

Commit 02d7c21

Browse files
Merge pull request #290560 from whhender/ropc-for-synapse
ROPC updates for Synapse
2 parents ffd869c + abd7dd3 commit 02d7c21

9 files changed

+147
-134
lines changed

articles/synapse-analytics/data-explorer/ingest-data/data-explorer-ingest-event-hub-csharp.md

Lines changed: 10 additions & 10 deletions
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,6 @@
11
---
2-
title: Use C\# ingestion to ingest data from Event Hub into Azure Synapse Data Explorer (Preview)
3-
description: Learn how to use C\# to ingest (load) data into Azure Synapse Data Explorer from Event Hub.
2+
title: Use C\# ingestion to ingest data from Event Hubs into Azure Synapse Data Explorer (Preview)
3+
description: Learn how to use C\# to ingest (load) data into Azure Synapse Data Explorer from Event Hubs.
44
ms.topic: how-to
55
ms.date: 11/02/2021
66
author: shsagir
@@ -10,7 +10,7 @@ ms.service: azure-synapse-analytics
1010
ms.subservice: data-explorer
1111
---
1212

13-
# Create an Event Hub data connection for Azure Synapse Data Explorer by using C# (Preview)
13+
# Create an Event Hubs data connection for Azure Synapse Data Explorer by using C# (Preview)
1414

1515
> [!div class="op_single_selector"]
1616
> * [Portal](data-explorer-ingest-event-hub-portal.md)
@@ -21,13 +21,13 @@ ms.subservice: data-explorer
2121
2222
[!INCLUDE [data-connector-intro](../includes/data-explorer-ingest-data-intro.md)]
2323

24-
In this article, you create an Event Hub data connection for Azure Synapse Data Explorer by using C\#.
24+
In this article, you create an Event Hubs data connection for Azure Synapse Data Explorer by using C\#.
2525

2626
## Prerequisites
2727

2828
[!INCLUDE [data-explorer-ingest-prerequisites](../includes/data-explorer-ingest-prerequisites.md)]
2929

30-
- [Event Hub with data for ingestion](data-explorer-ingest-event-hub-portal.md#create-an-event-hub).
30+
- [Event hub with data for ingestion](data-explorer-ingest-event-hub-portal.md#create-an-event-hub).
3131

3232
> [!NOTE]
3333
> Ingesting data from an Event Hub into Data Explorer pools will not work if your Synapse workspace uses a managed virtual network with data exfiltration protection enabled.
@@ -42,9 +42,9 @@ In this article, you create an Event Hub data connection for Azure Synapse Data
4242

4343
[!INCLUDE [data-explorer-authentication](../includes/data-explorer-authentication.md)]
4444

45-
## Add an Event Hub data connection
45+
## Add an Event Hubs data connection
4646

47-
The following example shows you how to add an Event Hub data connection programmatically. See [connect to the Event Hub](data-explorer-ingest-event-hub-portal.md#connect-to-the-event-hub) for information about adding an Event Hub data connection using the Azure portal.
47+
The following example shows you how to add an Event Hubs data connection programmatically. See [connect to the Event Hubs](data-explorer-ingest-event-hub-portal.md#connect-to-the-event-hubs) for information about adding an Event Hubs data connection using the Azure portal.
4848

4949
```csharp
5050
var tenantId = "xxxxxxxx-xxxxx-xxxx-xxxx-xxxxxxxxx";//Directory (tenant) ID
@@ -93,14 +93,14 @@ await kustoManagementClient.DataConnections.CreateOrUpdateAsync(resourceGroupNam
9393
| tableName | *StormEvents* | The name of the target table in the target database.|
9494
| mappingRuleName | *StormEvents_CSV_Mapping* | The name of your column mapping related to the target table.|
9595
| dataFormat | *csv* | The data format of the message.|
96-
| eventHubResourceId | *Resource ID* | The resource ID of your Event Hub that holds the data for ingestion. |
97-
| consumerGroup | *$Default* | The consumer group of your Event Hub.|
96+
| eventHubResourceId | *Resource ID* | The resource ID of your event hub that holds the data for ingestion. |
97+
| consumerGroup | *$Default* | The consumer group of your event hub.|
9898
| location | *Central US* | The location of the data connection resource.|
9999
| compression | *Gzip* or *None* | The type of data compression. |
100100

101101
## Generate data
102102

103-
See the [sample app](https://github.com/Azure-Samples/event-hubs-dotnet-ingest) that generates data and sends it to an Event Hub.
103+
See the [sample app](https://github.com/Azure-Samples/event-hubs-dotnet-ingest) that generates data and sends it to an event hub.
104104

105105
An event can contain one or more records, up to its size limit. In the following sample we send two events, each has five records appended:
106106

articles/synapse-analytics/data-explorer/ingest-data/data-explorer-ingest-event-hub-one-click.md

Lines changed: 18 additions & 18 deletions
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,6 @@
11
---
2-
title: Use one-click ingestion to ingest data from Event Hub into Azure Synapse Data Explorer (Preview)
3-
description: Learn how to use one-click to ingest (load) data into Azure Synapse Data Explorer from Event Hub.
2+
title: Use one-select ingestion to ingest data from Event Hubs into Azure Synapse Data Explorer (Preview)
3+
description: Learn how to use one-select to ingest (load) data into Azure Synapse Data Explorer from Event Hubs.
44
ms.topic: how-to
55
ms.date: 11/02/2021
66
author: shsagir
@@ -9,7 +9,7 @@ ms.reviewer: tzgitlin
99
ms.service: azure-synapse-analytics
1010
ms.subservice: data-explorer
1111
---
12-
# Use one-click ingestion to create an Event Hub data connection for Azure Synapse Data Explorer (Preview)
12+
# Use one-select ingestion to create an Event Hubs data connection for Azure Synapse Data Explorer (Preview)
1313

1414
> [!div class="op_single_selector"]
1515
> * [Portal](data-explorer-ingest-event-hub-portal.md)
@@ -18,13 +18,13 @@ ms.subservice: data-explorer
1818
> * [Python](data-explorer-ingest-event-hub-python.md)
1919
> * [Azure Resource Manager template](data-explorer-ingest-event-hub-resource-manager.md)
2020
21-
Azure Synapse Data Explorer offers ingestion (data loading) from Event Hubs, a big data streaming platform and event ingestion service. [Event Hubs](../../../event-hubs/event-hubs-about.md) can process millions of events per second in near real-time. In this article, you connect an Event Hub to a table in Azure Synapse Data Explorer using the [one-click ingestion](data-explorer-ingest-data-one-click.md) experience.
21+
Azure Synapse Data Explorer offers ingestion (data loading) from Event Hubs, a big data streaming platform and event ingestion service. [Event Hubs](../../../event-hubs/event-hubs-about.md) can process millions of events per second in near real-time. In this article, you connect an Event Hubs to a table in Azure Synapse Data Explorer using the [one-select ingestion](data-explorer-ingest-data-one-click.md) experience.
2222

2323
## Prerequisites
2424

2525
[!INCLUDE [data-explorer-ingest-prerequisites](../includes/data-explorer-ingest-prerequisites.md)]
2626

27-
- [Event Hub with data for ingestion](data-explorer-ingest-event-hub-portal.md#create-an-event-hub).
27+
- [Event Hubs with data for ingestion](data-explorer-ingest-event-hub-portal.md#create-an-event-hub).
2828

2929
> [!NOTE]
3030
> Ingesting data from an Event Hub into Data Explorer pools will not work if your Synapse workspace uses a managed virtual network with data exfiltration protection enabled.
@@ -39,7 +39,7 @@ Azure Synapse Data Explorer offers ingestion (data loading) from Event Hubs, a b
3939

4040
1. In the left menu of the Web UI, select the **Data** tab.
4141

42-
:::image type="content" source="../media/ingest-data-event-hub/one-click-ingestion-event-hub.png" alt-text="Select one-click ingest data from Event Hub in the web UI.":::
42+
:::image type="content" source="../media/ingest-data-event-hub/one-click-ingestion-event-hub.png" alt-text="Screenshot showing the Azure Data Explorer Data menu with ingest from event hub highlighted.":::
4343

4444
1. In the **Ingest data from Event Hub** card, select **Ingest**.
4545

@@ -64,29 +64,29 @@ The **Ingest new data** window opens with the **Destination** tab selected.
6464

6565
1. Under **Data Connection**, fill in the following fields:
6666

67-
:::image type="content" source="../media/ingest-data-one-click/select-azure-data-explorer-ingest-event-hub-details.png" alt-text="Screenshot of source tab with project details fields to be filled in - ingest new data to Azure Synapse Data Explorer with Event Hub in the one click experience.":::
67+
:::image type="content" source="../media/ingest-data-one-click/select-azure-data-explorer-ingest-event-hub-details.png" alt-text="Screenshot of source tab with project details fields to be filled in - ingest new data to Azure Synapse Data Explorer with Event Hubs in the one select experience.":::
6868

6969
|**Setting** | **Suggested value** | **Field description**
7070
|---|---|---|
7171
| Data connection name | *ContosoDataConnection* | The name that identifies your data connection.
72-
| Subscription | | The subscription ID where the Event Hub resource is located. |
73-
| Event Hub namespace | | The name that identifies your namespace. |
74-
| Event Hub | | The Event Hub you wish to use. |
75-
| Consumer group | | The consumer group defined in your Event Hub. |
76-
| Event system properties | Select relevant properties | The [Event Hub system properties](../../../service-bus-messaging/service-bus-amqp-protocol-guide.md#message-annotations). If there are multiple records per event message, the system properties will be added to the first one. When adding system properties, [create](/azure/data-explorer/kusto/management/create-table-command?context=/azure/synapse-analytics/context/context) or [update](/azure/data-explorer/kusto/management/alter-table-command?context=/azure/synapse-analytics/context/context) table schema and [mapping](/azure/data-explorer/kusto/management/mappings?context=/azure/synapse-analytics/context/context) to include the selected properties. |
72+
| Subscription | | The subscription ID where the Event Hubs resource is located. |
73+
| Event Hubs namespace | | The name that identifies your namespace. |
74+
| Event Hubs | | The Event Hubs you wish to use. |
75+
| Consumer group | | The consumer group defined in your Event Hubs. |
76+
| Event system properties | Select relevant properties | The [Event Hubs system properties](../../../service-bus-messaging/service-bus-amqp-protocol-guide.md#message-annotations). If there are multiple records per event message, the system properties will be added to the first one. When adding system properties, [create](/azure/data-explorer/kusto/management/create-table-command?context=/azure/synapse-analytics/context/context) or [update](/azure/data-explorer/kusto/management/alter-table-command?context=/azure/synapse-analytics/context/context) table schema and [mapping](/azure/data-explorer/kusto/management/mappings?context=/azure/synapse-analytics/context/context) to include the selected properties. |
7777

7878
1. Select **Next: Schema**.
7979

8080
## Schema tab
8181

82-
Data is read from the Event Hub in form of [EventData](/dotnet/api/microsoft.servicebus.messaging.eventdata) objects. Supported formats are CSV, JSON, PSV, SCsv, SOHsv TSV, TXT, and TSVE.
82+
Data is read from the Event Hubs in form of [EventData](/dotnet/api/microsoft.servicebus.messaging.eventdata) objects. Supported formats are CSV, JSON, PSV, SCsv, SOHsv TSV, TXT, and TSVE.
8383

8484
<!-- For information on schema mapping with JSON-formatted data, see [Edit the schema](one-click-ingestion-existing-table.md#edit-the-schema).
8585
For information on schema mapping with CSV-formatted data, see [Edit the schema](one-click-ingestion-new-table.md#edit-the-schema). -->
8686

87-
:::image type="content" source="../media/ingest-data-event-hub/schema-tab.png" alt-text="Screenshot of schema tab in ingest new data to Azure Synapse Data Explorer with Event Hub in the one click experience.":::
87+
:::image type="content" source="../media/ingest-data-event-hub/schema-tab.png" alt-text="Screenshot of schema tab in ingest new data to Azure Synapse Data Explorer with Event Hubs in the one select experience.":::
8888

89-
1. If the data you see in the preview window is not complete, you may need more data to create a table with all necessary data fields. Use the following commands to fetch new data from your Event Hub:
89+
1. If the data you see in the preview window isn't complete, you may need more data to create a table with all necessary data fields. Use the following commands to fetch new data from your Event Hubs:
9090
* **Discard and fetch new data**: discards the data presented and searches for new events.
9191
* **Fetch more data**: Searches for more events in addition to the events already found.
9292

@@ -95,11 +95,11 @@ For information on schema mapping with CSV-formatted data, see [Edit the schema]
9595
9696
1. Select **Next: Summary**.
9797

98-
## Continuous ingestion from Event Hub
98+
## Continuous ingestion from Event Hubs
9999

100-
In the **Continuous ingestion from Event Hub established** window, all steps will be marked with green check marks when establishment finishes successfully. The cards below these steps give you options to explore your data with **Quick queries**, undo changes made using **Tools**, or **Monitor** the Event Hub connections and data.
100+
In the **Continuous ingestion from Event Hub established** window, all steps will be marked with green check marks when establishment finishes successfully. The cards below these steps give you options to explore your data with **Quick queries**, undo changes made using **Tools**, or **Monitor** the Event Hubs connections and data.
101101

102-
:::image type="content" source="../media/ingest-data-event-hub/data-ingestion-completed.png" alt-text="Screenshot of final screen in ingestion to Azure Synapse Data Explorer from Event Hub with the one click experience.":::
102+
:::image type="content" source="../media/ingest-data-event-hub/data-ingestion-completed.png" alt-text="Screenshot of final screen in ingestion to Azure Synapse Data Explorer from Event Hubs with the one select experience.":::
103103

104104
## Next steps
105105

0 commit comments

Comments
 (0)