You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/event-hubs/event-hubs-capture-enable-through-portal.md
+7-26Lines changed: 7 additions & 26 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -8,7 +8,7 @@ ms.custom: mode-ui
8
8
9
9
# Enable capturing of events streaming through Azure Event Hubs
10
10
11
-
Azure [Event Hubs Capture][capture-overview] enables you to automatically deliver the streaming data in Event Hubs to an [Azure Blob storage](https://azure.microsoft.com/services/storage/blobs/) or [Azure Data Lake Storage Gen1 or Gen 2](https://azure.microsoft.com/services/data-lake-store/) account of your choice.You can configure capture settings using the [Azure portal](https://portal.azure.com) when creating an event hub or for an existing event hub. For conceptual information on this feature, see [Event Hubs Capture overview][capture-overview].
11
+
Azure [Event Hubs Capture][capture-overview] enables you to automatically deliver the streaming data in Event Hubs to an [Azure Blob storage](https://azure.microsoft.com/services/storage/blobs/) or [Azure Data Lake Storage Gen 2](https://azure.microsoft.com/services/data-lake-store/) account of your choice.You can configure capture settings using the [Azure portal](https://portal.azure.com) when creating an event hub or for an existing event hub. For conceptual information on this feature, see [Event Hubs Capture overview][capture-overview].
12
12
13
13
> [!IMPORTANT]
14
14
> Event Hubs doesn't support capturing events in a **premium** storage account.
@@ -33,6 +33,10 @@ To create an event hub within the namespace, follow these steps:
33
33
34
34
See one of the following sections based on the type of storage you want to use to store captured files.
35
35
36
+
37
+
> [!IMPORTANT]
38
+
> Azure Data Lake Storage Gen1 is retired, so don't use it for capturing event data. For more information, see the [official announcement](https://azure.microsoft.com/updates/action-required-switch-to-azure-data-lake-storage-gen2-by-29-february-2024/). If you are using Azure Data Lake Storage Gen1, migrate to Azure Data Lake Storage Gen2. For more information, see [Azure Data Lake Storage migration guidelines and patterns](../storage/blobs/data-lake-storage-migrate-gen1-to-gen2.md).
39
+
36
40
## Capture data to Azure Storage
37
41
38
42
1. For **Capture Provider**, select **Azure Storage Account** (default).
@@ -55,7 +59,7 @@ See one of the following sections based on the type of storage you want to use t
55
59
56
60
Follow [Create a storage account](../storage/common/storage-account-create.md?tabs=azure-portal#create-a-storage-account) article to create an Azure Storage account. Set **Hierarchical namespace** to **Enabled** on the **Advanced** tab to make it an Azure Data Lake Storage Gen 2 account. The Azure Storage account must be in the same subscription as the event hub.
57
61
58
-
1. Select **Azure Storage** as the capture provider. The **Azure Data Lake Store** option you see for the **Capture provider** is for the Gen 1 of Azure Data Lake Storage. To use a Gen 2 of Azure Data Lake Storage, you select **Azure Storage**.
62
+
1. Select **Azure Storage** as the capture provider. To use Azure Data Lake Storage Gen2, you select **Azure Storage**.
59
63
2. For **Azure Storage Container**, click the **Select the container** link.
60
64
61
65
:::image type="content" source="./media/event-hubs-capture-enable-through-portal/select-container-link.png" alt-text="Screenshot that shows the Create event hub page with the Select container link.":::
@@ -75,28 +79,6 @@ Follow [Create a storage account](../storage/common/storage-account-create.md?ta
75
79
> The container you create in an Azure Data Lake Storage Gen 2 using this user interface (UI) is shown under **File systems** in **Storage Explorer**. Similarly, the file system you create in a Data Lake Storage Gen 2 account shows up as a container in this UI.
76
80
77
81
78
-
## Capture data to Azure Data Lake Storage Gen 1
79
-
80
-
To capture data to Azure Data Lake Storage Gen 1, you create a Data Lake Storage Gen 1 account, and an event hub:
81
-
82
-
> [!IMPORTANT]
83
-
> On Feb 29, 2024 Azure Data Lake Storage Gen1 will be retired. For more information, see the [official announcement](https://azure.microsoft.com/updates/action-required-switch-to-azure-data-lake-storage-gen2-by-29-february-2024/). If you use Azure Data Lake Storage Gen1, make sure to migrate to Azure Data Lake Storage Gen2 prior to that date. For more information, see [Azure Data Lake Storage migration guidelines and patterns](../storage/blobs/data-lake-storage-migrate-gen1-to-gen2.md).
84
-
85
-
### Create an Azure Data Lake Storage Gen 1 account and folders
86
-
87
-
1. Create a Data Lake Storage account, following the instructions in [Get started with Azure Data Lake Storage Gen 1 using the Azure portal](../data-lake-store/data-lake-store-get-started-portal.md).
88
-
2. Follow the instructions in the [Assign permissions to Event Hubs](../data-lake-store/data-lake-store-archive-eventhub-capture.md#assign-permissions-to-event-hubs) section to create a folder within the Data Lake Storage Gen 1 account in which you want to capture the data from Event Hubs, and assign permissions to Event Hubs so that it can write data into your Data Lake Storage Gen 1 account.
89
-
90
-
91
-
### Create an event hub
92
-
93
-
1. The event hub must be in the same Azure subscription as the Azure Data Lake Storage Gen 1 account you created. Create the event hub, clicking the **On** button under **Capture** in the **Create Event Hub** portal page.
94
-
2. On the **Create Event Hub** page, select **Azure Data Lake Store** from the **Capture Provider** box.
95
-
3. In **Select Store** next to the **Data Lake Store** drop-down list, specify the Data Lake Storage Gen 1 account you created previously, and in the **Data Lake Path** field, enter the path to the data folder you created.
96
-
97
-
:::image type="content" source="./media/event-hubs-capture-enable-through-portal/event-hubs-capture3.png" alt-text="Screenshot showing the selection of Data Lake Storage Account Gen 1.":::
98
-
99
-
100
82
## Configure Capture for an existing event hub
101
83
102
84
You can configure Capture on existing event hubs that are in Event Hubs namespaces. To enable Capture on an existing event hub, or to change your Capture settings, follow these steps:
@@ -114,8 +96,7 @@ You can configure Capture on existing event hubs that are in Event Hubs namespac
114
96
:::image type="content" source="./media/event-hubs-capture-enable-through-portal/enable-capture.png" alt-text="Screenshot showing the Capture page for your event hub with the Capture feature enabled.":::
115
97
1. To configure other settings, see the sections:
116
98
-[Capture data to Azure Storage](#capture-data-to-azure-storage)
117
-
-[Capture data to Azure Data Lake Storage Gen 2](#capture-data-to-azure-data-lake-storage-gen-2)
118
-
-[Capture data to Azure Data Lake Storage Gen 1](#capture-data-to-azure-data-lake-storage-gen-1)
99
+
-[Capture data to Azure Data Lake Storage Gen 2](#capture-data-to-azure-data-lake-storage-gen-2)
@@ -19,13 +19,14 @@ For more information about patterns and practices for Azure Resources naming con
19
19
20
20
For the complete templates, select the following GitHub links:
21
21
22
-
-[Event hub and enable Capture to Storage template][Event Hub and enable Capture to Storage template]
23
-
-[Event hub and enable Capture to Azure Data Lake Store template][Event Hub and enable Capture to Azure Data Lake Store template]
22
+
-[Create an event hub and enable Capture to Storage template][Event Hub and enable Capture to Storage template]
23
+
-[Create an event hub and enable Capture to Azure Data Lake Store template][Event Hub and enable Capture to Azure Data Lake Store template]
24
24
25
25
> [!NOTE]
26
26
> To check for the latest templates, visit the [Azure Quickstart Templates][Azure Quickstart Templates] gallery and search for Event Hubs.
27
-
>
28
-
>
27
+
28
+
> [!IMPORTANT]
29
+
> Azure Data Lake Storage Gen1 is retired, so don't use it for capturing event data. For more information, see the [official announcement](https://azure.microsoft.com/updates/action-required-switch-to-azure-data-lake-storage-gen2-by-29-february-2024/). If you are using Azure Data Lake Storage Gen1, migrate to Azure Data Lake Storage Gen2. For more information, see [Azure Data Lake Storage migration guidelines and patterns](../storage/blobs/data-lake-storage-migrate-gen1-to-gen2.md).
29
30
30
31
## What will you deploy?
31
32
@@ -166,7 +167,7 @@ The size interval at which Capture starts capturing the data.
166
167
167
168
### captureNameFormat
168
169
169
-
The name format used by Event Hubs Capture to write the Avro files. Note that a Capture name format must contain `{Namespace}`, `{EventHub}`, `{PartitionId}`, `{Year}`, `{Month}`, `{Day}`, `{Hour}`, `{Minute}`, and `{Second}` fields. These can be arranged in any order, with or without delimiters.
170
+
The name format used by Event Hubs Capture to write the Avro files. The capture name format must contain `{Namespace}`, `{EventHub}`, `{PartitionId}`, `{Year}`, `{Month}`, `{Day}`, `{Hour}`, `{Minute}`, and `{Second}` fields. These fields can be arranged in any order, with or without delimiters.
170
171
171
172
```json
172
173
"captureNameFormat": {
@@ -221,8 +222,6 @@ The blob container in which to capture your event data.
221
222
}
222
223
```
223
224
224
-
Use the following parameters if you choose Azure Data Lake Store Gen 1 as your destination. You must set permissions on your Data Lake Store path, in which you want to Capture the event. To set permissions, see [Capture data to Azure Data Lake Storage Gen 1](event-hubs-capture-enable-through-portal.md#capture-data-to-azure-data-lake-storage-gen-1).
225
-
226
225
### subscriptionId
227
226
228
227
Subscription ID for the Event Hubs namespace and Azure Data Lake Store. Both these resources must be under the same subscription ID.
@@ -251,7 +250,7 @@ The Azure Data Lake Store name for the captured events.
251
250
252
251
### dataLakeFolderPath
253
252
254
-
The destination folder path for the captured events. This is the folder in your Data Lake Store to which the events will be pushed during the capture operation. To set permissions on this folder, see [Use Azure Data Lake Store to capture data from Event Hubs](../data-lake-store/data-lake-store-archive-eventhub-capture.md).
253
+
The destination folder path for the captured events. This path is the folder in your Data Lake Store to which the events are pushed during the capture operation. To set permissions on this folder, see [Use Azure Data Lake Store to capture data from Event Hubs](../data-lake-store/data-lake-store-archive-eventhub-capture.md).
255
254
256
255
```json
257
256
"dataLakeFolderPath": {
@@ -264,7 +263,7 @@ The destination folder path for the captured events. This is the folder in your
264
263
265
264
## Azure Storage or Azure Data Lake Storage Gen 2 as destination
266
265
267
-
Creates a namespace of type **EventHub**, with one event hub, and also enables Capture to Azure Blob Storage or Azure Data Lake Storage Gen2.
266
+
Creates a namespace of type `Microsoft.EventHub/Namespaces`, with one event hub, and also enables Capture to Azure Blob Storage or Azure Data Lake Storage Gen2.
268
267
269
268
```json
270
269
"resources":[
@@ -324,57 +323,6 @@ Creates a namespace of type **EventHub**, with one event hub, and also enables C
324
323
]
325
324
```
326
325
327
-
## Azure Data Lake Storage Gen1 as destination
328
-
329
-
Creates a namespace of type **EventHub**, with one event hub, and also enables Capture to Azure Data Lake Storage Gen1. If you're using Gen2 of Data Lake Storage, see the previous section.
0 commit comments