Skip to content

Commit e53e950

Browse files
committed
Azure Event Hubs - Freshness, Acrolynx, Learn Linter
1 parent 2986ae1 commit e53e950

11 files changed

+52
-38
lines changed

articles/event-hubs/azure-event-hubs-kafka-overview.md

Lines changed: 14 additions & 14 deletions
Original file line numberDiff line numberDiff line change
@@ -1,25 +1,26 @@
11
---
22
title: Introduction to Apache Kafka in Event Hubs on Azure Cloud
3-
description: Learn what Apache Kafka in the Event Hubs service on Azure Cloud is and how to use it to stream data from Apache Kafka applications without setting up a Kafka cluster on your own.
3+
description: Learn what Apache Kafka in Azure Event Hubs is and how to use it to stream data from Apache Kafka applications without setting up a Kafka cluster on your own.
44
ms.topic: overview
5-
ms.date: 11/16/2023
5+
ms.date: 12/12/2024
6+
# Customer intent: How does Azure Event Hubs support the Apache Kafka protocol?
67
---
78

8-
# What is Azure Event Hubs for Apache Kafka
9+
# What is Azure Event Hubs for Apache Kafka?
10+
11+
This article explains how you can use Azure Event Hubs to stream data from [Apache Kafka](https://kafka.apache.org) applications without setting up a Kafka cluster on your own.
912

10-
This article explains how you can use Azure Event Hubs to stream data from [Apache Kafka](https://kafka.apache.org) applications without setting up a Kafka cluster on your own.
1113

12-
> [!NOTE]
13-
> This feature is supported only in the **standard, premium** and **dedicated** tiers.
1414

1515
## Overview
1616

1717
Azure Event Hubs provides an Apache Kafka endpoint on an event hub, which enables users to connect to the event hub using the Kafka protocol. You can often use an event hub's Kafka endpoint from your applications without any code changes. You modify only the configuration, that is, update the connection string in configurations to point to the Kafka endpoint exposed by your event hub instead of pointing to a Kafka cluster. Then, you can start streaming events from your applications that use the Kafka protocol into event hubs, which are equivalent to Kafka topics.
1818

19-
To learn more about how to migrate your Kafka applications to Azure Event Hubs, please see the [migration guide](apache-kafka-migration-guide.md).
19+
To learn more about how to migrate your Kafka applications to Azure Event Hubs, see the [migration guide](apache-kafka-migration-guide.md).
2020

2121
> [!NOTE]
22-
> Event Hubs for Kafka Ecosystems supports [Apache Kafka version 1.0](https://kafka.apache.org/10/documentation.html) and later.
22+
> - This feature is supported only in the **standard, premium** and **dedicated** tiers.
23+
> - Event Hubs for Kafka Ecosystems supports [Apache Kafka version 1.0](https://kafka.apache.org/10/documentation.html) and later.
2324
2425
## Apache Kafka and Azure Event Hubs conceptual mapping
2526

@@ -37,11 +38,10 @@ Conceptually, Kafka and Event Hubs are very similar. They're both partitioned lo
3738

3839
### Kafka Streams
3940

41+
Kafka Streams is a client library for stream analytics that is part of the Apache Kafka open-source project, but is separate from the Apache Kafka event broker.
42+
4043
> [!NOTE]
4144
> Kafka Streams is currently in Public preview in Premium, and Dedicated tier.
42-
>
43-
44-
Kafka Streams is a client library for stream analytics that is part of the Apache Kafka open-source project, but is separate from the Apache Kafka event broker.
4545
4646
Azure Event Hubs supports the Kafka Streams client library, with details and concepts available [here](apache-kafka-streams.md).
4747

@@ -56,7 +56,7 @@ Standalone and without ksqlDB, Kafka Streams has fewer capabilities than many al
5656
- [Apache Storm](event-hubs-storm-getstarted-receive.md)
5757
- [Apache Spark](event-hubs-kafka-spark-tutorial.md)
5858
- [Apache Flink](event-hubs-kafka-flink-tutorial.md)
59-
- [Apache Flink on HDInsight on AKS](../hdinsight-aks/flink/flink-overview.md)
59+
- [Apache Flink on HDInsight on Azure Kubernetes Service](../hdinsight-aks/flink/flink-overview.md)
6060
- [Akka Streams](event-hubs-kafka-akka-streams-tutorial.md)
6161

6262
### Kafka Transactions
@@ -150,7 +150,7 @@ For a **tutorial** with step-by-step instructions to create an event hub and acc
150150

151151
## Other Azure Event Hubs features
152152

153-
The Event Hubs for Apache Kafka feature is one of three protocols concurrently available on Azure Event Hubs, complementing HTTP and AMQP. You can write with any of these protocols and read with any another, so that your current Apache Kafka producers can continue publishing via Apache Kafka, but your reader can benefit from the native integration with Event Hubs' AMQP interface, such as Azure Stream Analytics or Azure Functions. Conversely, you can readily integrate Azure Event Hubs into AMQP routing networks as a target endpoint, and yet read data through Apache Kafka integrations.
153+
The Event Hubs for Apache Kafka feature is one of three protocols concurrently available on Azure Event Hubs along with HTTP and AMQP. You can write with any of these protocols and read with any another, so that your current Apache Kafka producers can continue publishing via Apache Kafka, but your reader can benefit from the native integration with Event Hubs' AMQP interface, such as Azure Stream Analytics or Azure Functions. Conversely, you can readily integrate Azure Event Hubs into AMQP routing networks as a target endpoint, and yet read data through Apache Kafka integrations.
154154

155155
Additionally, Event Hubs features such as [Capture](event-hubs-capture-overview.md), which enables extremely cost efficient long-term archival via Azure Blob Storage and Azure Data Lake Storage, and [Geo Disaster-Recovery](event-hubs-geo-dr.md) also work with the Event Hubs for Kafka feature.
156156

@@ -160,7 +160,7 @@ Azure Event Hubs for Apache Kafka supports both idempotent producers and idempot
160160

161161
One of the core tenets of Azure Event Hubs is the concept of **at-least once** delivery. This approach ensures that events will always be delivered. It also means that events can be received more than once, even repeatedly, by consumers such as a function. For this reason, it's important that the consumer supports the [idempotent consumer](https://microservices.io/patterns/communication-style/idempotent-consumer.html) pattern.
162162

163-
## Next steps
163+
## Related content
164164
This article provided an introduction to Event Hubs for Kafka. To learn more, see [Apache Kafka developer guide for Azure Event Hubs](apache-kafka-developer-guide.md).
165165

166166
For a **tutorial** with step-by-step instructions to create an event hub and access it using SAS or OAuth, see [Quickstart: Data streaming with Event Hubs using the Kafka protocol](event-hubs-quickstart-kafka-enabled-event-hubs.md).

articles/event-hubs/event-hubs-capture-enable-through-portal.md

Lines changed: 18 additions & 8 deletions
Original file line numberDiff line numberDiff line change
@@ -2,14 +2,22 @@
22
title: Event Hubs - Capture streaming events using Azure portal
33
description: This article describes how to enable capturing of events streaming through Azure Event Hubs by using the Azure portal.
44
ms.topic: quickstart
5-
ms.date: 07/07/2023
5+
ms.date: 12/12/2024
66
ms.custom: mode-ui
7+
# Customer intent: I want to enable capturing of events for an Azure event hub.
78
---
89

9-
# Enable capturing of events streaming through Azure Event Hubs
10+
# Quickstart: Enable capturing of events streaming through Azure Event Hubs
11+
In this quickstart, you learn how to use the Azure portal to enable capturing of events to Azure Storage or Azure Data Lake Store.
1012

1113
Azure [Event Hubs Capture][capture-overview] enables you to automatically deliver the streaming data in Event Hubs to an [Azure Blob storage](https://azure.microsoft.com/services/storage/blobs/) or [Azure Data Lake Storage Gen 2](https://azure.microsoft.com/services/data-lake-store/) account of your choice. You can configure capture settings using the [Azure portal](https://portal.azure.com) when creating an event hub or for an existing event hub. For conceptual information on this feature, see [Event Hubs Capture overview][capture-overview].
1214

15+
16+
## Prerequisites
17+
18+
- An Azure subscription. If you don't have one, [create a free account](https://azure.microsoft.com/free/) before you begin.
19+
- If you are new to Azure Event Hubs, read through [Event Hubs overview](event-hubs-about.md) and [Event Hubs features](event-hubs-features.md).
20+
1321
> [!IMPORTANT]
1422
> Event Hubs only supports **Premium** Storage account with **Block Blob** support.
1523
@@ -31,6 +39,7 @@ To create an event hub within the namespace, follow these steps:
3139
1. Drag the slider to set the **Size window (MB)**. The default value is 300 MB. The minimum value is 10 MB and the maximum value is 500 MB.
3240
1. Specify whether you want Event Hubs to **emit empty files when no events occur during the Capture time window**.
3341

42+
:::image type="content" source="./media/event-hubs-capture-enable-through-portal/capture-basic-settings.png" alt-text="Screenshot of the Capture tab of the Create event hub page with basic settings.":::
3443
See one of the following sections based on the type of storage you want to use to store captured files.
3544

3645

@@ -40,16 +49,18 @@ See one of the following sections based on the type of storage you want to use t
4049
## Capture data to Azure Storage
4150

4251
1. For **Capture Provider**, select **Azure Storage Account** (default).
43-
1. For **Azure Storage Container**, click the **Select the container** link.
52+
1. For **Azure Storage Container**, choose the **Select the container** link.
4453

4554
:::image type="content" source="./media/event-hubs-capture-enable-through-portal/select-container-link.png" alt-text="Screenshot that shows the Create event hub page with the Select container link.":::
4655
1. On the **Storage accounts** page, select the storage account that you want to use to capture data.
47-
1. On the **Containers** page, select the container where you want to store captured files, and then click **Select**.
56+
1. On the **Containers** page, select the container where you want to store captured files, and then choose **Select**.
4857

4958
Because Event Hubs Capture uses service-to-service authentication with storage, you don't need to specify a storage connection string. The resource picker selects the resource URI for your storage account automatically. If you use Azure Resource Manager, you must supply this URI explicitly as a string.
5059
1. Now, on the **Create event hub** page, confirm that the selected container shows up.
5160
1. For **Capture file name format**, specify format for the captured file names.
5261
1. Select **Review + create** at the bottom of the page.
62+
63+
:::image type="content" source="./media/event-hubs-capture-enable-through-portal/azure-storage-settings.png" alt-text="Screenshot of the Capture tab of the Create event hub page with Azure Storage settings.":::
5364
1. On the **Review + create** page, review settings, and select **Create** to create the event hub.
5465

5566
> [!NOTE]
@@ -60,13 +71,13 @@ See one of the following sections based on the type of storage you want to use t
6071
Follow [Create a storage account](../storage/common/storage-account-create.md?tabs=azure-portal#create-a-storage-account) article to create an Azure Storage account. Set **Hierarchical namespace** to **Enabled** on the **Advanced** tab to make it an Azure Data Lake Storage Gen 2 account. The Azure Storage account must be in the same subscription as the event hub.
6172

6273
1. Select **Azure Storage** as the capture provider. To use Azure Data Lake Storage Gen2, you select **Azure Storage**.
63-
2. For **Azure Storage Container**, click the **Select the container** link.
74+
2. For **Azure Storage Container**, choose the **Select the container** link.
6475

6576
:::image type="content" source="./media/event-hubs-capture-enable-through-portal/select-container-link.png" alt-text="Screenshot that shows the Create event hub page with the Select container link.":::
6677
3. Select the **Azure Data Lake Storage Gen 2** account from the list.
6778

6879
:::image type="content" source="./media/event-hubs-capture-enable-through-portal/select-data-lake-storage-gen2.png" alt-text="Screenshot showing the selection of Data Lake Storage Gen 2 account.":::
69-
4. Select the **container** (file system in Data Lake Storage Gen 2), and then click **Select** at the bottom of the page.
80+
4. Select the **container** (file system in Data Lake Storage Gen 2), and then choose **Select** at the bottom of the page.
7081

7182
:::image type="content" source="./media/event-hubs-capture-enable-through-portal/select-file-system-data-lake-storage.png" alt-text="Screenshot that shows the Containers page.":::
7283
1. For **Capture file name format**, specify format for the captured file names.
@@ -98,11 +109,10 @@ You can configure Capture on existing event hubs that are in Event Hubs namespac
98109
- [Capture data to Azure Storage](#capture-data-to-azure-storage)
99110
- [Capture data to Azure Data Lake Storage Gen 2](#capture-data-to-azure-data-lake-storage-gen-2)
100111

101-
## Next steps
112+
## Related content
102113

103114
- Learn more about Event Hubs capture by reading the [Event Hubs Capture overview][capture-overview].
104115
- You can also configure Event Hubs Capture using Azure Resource Manager templates. For more information, see [Enable Capture using an Azure Resource Manager template](event-hubs-resource-manager-namespace-event-hub-enable-capture.md).
105116
- [Learn how to create an Azure Event Grid subscription with an Event Hubs namespace as its source](store-captured-data-data-warehouse.md)
106-
- [Get started with Azure Data Lake Store using the Azure portal](../data-lake-store/data-lake-store-get-started-portal.md)
107117

108118
[capture-overview]: event-hubs-capture-overview.md

articles/event-hubs/event-hubs-create.md

Lines changed: 15 additions & 12 deletions
Original file line numberDiff line numberDiff line change
@@ -1,17 +1,19 @@
11
---
2-
title: Azure Quickstart - Create an event hub using the Azure portal
3-
description: In this quickstart, you learn how to create an Azure event hub using Azure portal.
2+
title: Create an event hub using the Azure portal
3+
description: In this quickstart, you learn how to create an Azure Event Hubs namespace and an event hub in the namespace by using Azure portal.
44
ms.topic: quickstart
5-
ms.date: 11/27/2023
5+
ms.date: 12/12/2024
6+
# Customer intent: I want to know how create an Azure event hub using the Azure portal.
67
---
78

89
# Quickstart: Create an event hub using Azure portal
9-
Azure Event Hubs is a Big Data streaming platform and event ingestion service that can receive and process millions of events per second. Event Hubs can process and store events, data, or telemetry produced by distributed software and devices. Data sent to an event hub can be transformed and stored using any real-time analytics provider or batching/storage adapters. For detailed overview of Event Hubs, see [Event Hubs overview](event-hubs-about.md) and [Event Hubs features](event-hubs-features.md).
10+
In this quickstart, you create an Azure Event Hubs namespace and an event hub in the namespace by using the [Azure portal](https://portal.azure.com).
1011

11-
In this quickstart, you create an event hub using the [Azure portal](https://portal.azure.com).
1212

1313
## Prerequisites
14-
To complete this quickstart, make sure that you have an Azure subscription. If you don't have one, [create a free account](https://azure.microsoft.com/free/) before you begin.
14+
15+
- An Azure subscription. If you don't have one, [create a free account](https://azure.microsoft.com/free/) before you begin.
16+
- If you are new to Azure Event Hubs, read through [Event Hubs overview](event-hubs-about.md) and [Event Hubs features](event-hubs-features.md).
1517

1618
## Create a resource group
1719

@@ -33,27 +35,28 @@ A resource group is a logical collection of Azure resources. All resources are d
3335

3436
An Event Hubs namespace provides a unique scoping container, in which you create one or more event hubs. To create a namespace in your resource group using the portal, do the following actions:
3537

36-
1. In the Azure portal, select **All services** in the left menu, and select **star (`*`)** next to **Event Hubs** in the **Analytics** category. Confirm that **Event Hubs** is added to **FAVORITES** in the left navigational menu.
38+
1. In the Azure portal, select **All services** in the left menu, and select **Event Hubs** in the **Analytics** category.
3739

3840
:::image type="content" source="./media/event-hubs-quickstart-portal/select-event-hubs-menu.png" alt-text="Screenshot showing the selection of Event Hubs in the All services page.":::
39-
1. Select **Event Hubs** under **FAVORITES** in the left navigational menu, and select **Create** on the toolbar.
41+
1. On the **Event Hubs** page, select **Create** on the toolbar.
4042

41-
:::image type="content" source="./media/event-hubs-quickstart-portal/event-hubs-add-toolbar.png" alt-text="Screenshot showing the selection of Create button on the Event hubs page.":::
43+
:::image type="content" source="./media/event-hubs-quickstart-portal/event-hubs-add-toolbar.png" alt-text="Screenshot showing the selection of Create button on the Event hubs page." lightbox="./media/event-hubs-quickstart-portal/event-hubs-add-toolbar.png":::
4244
1. On the **Create namespace** page, take the following steps:
4345
1. Select the **subscription** in which you want to create the namespace.
4446
1. Select the **resource group** you created in the previous step.
4547
1. Enter a **name** for the namespace. The system immediately checks to see if the name is available.
4648
1. Select a **location** for the namespace.
4749
1. Choose **Basic** for the **pricing tier**. If you plan to use the namespace from **Apache Kafka** apps, use the **Standard** tier. The basic tier doesn't support Apache Kafka workloads. To learn about differences between tiers, see [Quotas and limits](event-hubs-quotas.md), [Event Hubs Premium](event-hubs-premium-overview.md), and [Event Hubs Dedicated](event-hubs-dedicated-overview.md) articles.
48-
1. Leave the **throughput units** (for standard tier) or **processing units** (for premium tier) settings as it is. To learn about throughput units or processing units: [Event Hubs scalability](event-hubs-scalability.md).
50+
1. Leave the **throughput units** (for standard tier) or **processing units** (for premium tier) settings as it is. To learn about throughput units or processing units: [Event Hubs scalability](event-hubs-scalability.md).
51+
1. Enable the **Auto-inflate** feature if you want Event Hubs to automatically increase the number of TUs to meet usage needs. Increasing TUs prevents throttling scenarios where data ingress or data egress rates exceed the rates allowed by the TUs assigned to the namespace. The Event Hubs service increases the throughput when load increases beyond the minimum threshold, without any requests failing with ServerBusy errors.
4952
1. Select **Review + Create** at the bottom of the page.
5053

5154
:::image type="content" source="./media/event-hubs-quickstart-portal/create-event-hub1.png" alt-text="Screenshot of the Create Namespace page in the Azure portal.":::
5255
1. On the **Review + Create** page, review the settings, and select **Create**. Wait for the deployment to complete.
5356
1. On the **Deployment** page, select **Go to resource** to navigate to the page for your namespace.
5457

5558
:::image type="content" source="./media/event-hubs-quickstart-portal/deployment-complete.png" alt-text="Screenshot of the Deployment complete page with the link to resource.":::
56-
1. Confirm that you see the **Event Hubs Namespace** page similar to the following example:
59+
1. Confirm that you see the **Event Hubs namespace** page similar to the following example:
5760

5861
:::image type="content" source="./media/event-hubs-quickstart-portal/namespace-home-page.png" lightbox="./media/event-hubs-quickstart-portal/namespace-home-page.png" alt-text="Screenshot of the home page for your Event Hubs namespace in the Azure portal.":::
5962

@@ -79,7 +82,7 @@ To create an event hub within the namespace, do the following actions:
7982

8083
:::image type="content" source="./media/event-hubs-quickstart-portal/event-hub-created.png" lightbox="./media/event-hubs-quickstart-portal/event-hub-created.png" alt-text="Screenshot showing the list of event hubs.":::
8184

82-
## Next steps
85+
## Related content
8386

8487
In this article, you created a resource group, an Event Hubs namespace, and an event hub. For step-by-step instructions to send events to (or) receive events from an event hub, see these tutorials:
8588

0 commit comments

Comments
 (0)