Skip to content

Commit 0eb793c

Browse files
authored
Update kafka-output.md
add steps for kafka output and screenshot
1 parent 30f8f58 commit 0eb793c

File tree

1 file changed

+18
-1
lines changed

1 file changed

+18
-1
lines changed

articles/stream-analytics/kafka-output.md

Lines changed: 18 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -5,14 +5,28 @@ author: enkrumah
55
ms.author: ebnkruma
66
ms.service: stream-analytics
77
ms.topic: conceptual
8-
ms.date: 01/18/2024
8+
ms.date: 02/20/2024
99
---
1010

1111
# Kafka output from Azure Stream Analytics (Preview)
1212

1313
Azure Stream Analytics allows you to connect directly to Kafka clusters as a producer to output data. The solution is low code and entirely managed by the Azure Stream Analytics team at Microsoft, allowing it to meet business compliance standards. The ASA Kafka output is backward compatible and supports all versions with the latest client release starting from version 0.10. Users can connect to Kafka clusters inside a VNET and Kafka clusters with a public endpoint, depending on the configurations. The configuration relies on existing Kafka configuration conventions.
1414
Supported compression types are None, Gzip, Snappy, LZ4, and Zstd.
1515

16+
## Steps
17+
This article shows how to set up Kafka as an output from Azure Stream Analytics. There are six steps:
18+
19+
1. Create an Azure Stream Analytics job.
20+
2. Configure your Azure Stream Analytics job to use managed identity if you are using mTLS or SASL_SSl security protocols.
21+
3. Configure Azure Key vault if you are using mTLS or SASL_SSl security protocols.
22+
4. Upload certificates as secrets into Azure Key vault.
23+
5. Grant Azure Stream Analytics permissions to access the uploaded certificate.
24+
6. Configure Kafka output in your Azure Stream Analytics job.
25+
26+
> [!NOTE]
27+
> Depending on how your Kafka cluster is configured and the type of Kafka cluster you are using, some of the above steps may not apply to you. Examples are: if you are using confluent cloud Kafka, you will not need to upload a certificate to use the Kafka connector. If your Kafka cluster is inside a virtual network (VNET) or behind a firewall, you may have to configure your Azure Stream Analytics job to access your Kafka topic using a private link or a dedicated networking configuration.
28+
29+
1630
## Configuration
1731
The following table lists the property names and their description for creating a Kafka output:
1832

@@ -26,6 +40,9 @@ The following table lists the property names and their description for creating
2640
| Partition key | Azure Stream Analytics assigns partitions using round partitioning. |
2741
| Kafka event compression type | The compression type used for outgoing data streams, such as Gzip, Snappy, Lz4, Zstd, or None. |
2842

43+
:::image type="content" source="./media/kafka/kafka-output.png" alt-text="Screenshot showing how to configure kafka output for a stream analytics job." lightbox="./media/kafka/kafka-output.png" :::
44+
45+
2946
## Authentication and encryption
3047

3148
You can use four types of security protocols to connect to your Kafka clusters:

0 commit comments

Comments
 (0)