Skip to content

Commit 564bf80

Browse files
authored
Update kafka-output.md
1 parent 162451e commit 564bf80

File tree

1 file changed

+17
-16
lines changed

1 file changed

+17
-16
lines changed

articles/stream-analytics/kafka-output.md

Lines changed: 17 additions & 16 deletions
Original file line numberDiff line numberDiff line change
@@ -5,45 +5,46 @@ author: enkrumah
55
ms.author: ebnkruma
66
ms.service: stream-analytics
77
ms.topic: conceptual
8-
ms.date: 09/25/2023
8+
ms.date: 09/26/2023
99
---
1010

1111
# Kafka Output from Azure Stream Analytics (Preview)
1212

13-
Azure Stream Analytics allows you to connect directly to kafka clusters as a producer to output data.The solution is low code and entirely managed by the Azure Stream Analytics team at Microsoft, allowing it to meet business compliance standards. The Kafka Adapters are backward compatible and support all Kafka versions with the latest client release starting from version 0.10. Users can connect to Kafka clusters inside a VNET and Kafka clusters with a public endpoint depending on the configurations. The configuration relies on existing Kafka configuration conventions.
13+
Azure Stream Analytics allows you to connect directly to Kafka clusters as a producer to output data. The solution is low code and entirely managed by the Azure Stream Analytics team at Microsoft, allowing it to meet business compliance standards. The Kafka Adapters are backward compatible and support all versions with the latest client release starting from version 0.10. Users can connect to Kafka clusters inside a VNET and Kafka clusters with a public endpoint, depending on the configurations. The configuration relies on existing Kafka configuration conventions.
1414

1515
### Kafka Event Compression
1616

17-
Supported compression types are: None, Gzip, Snappy, LZ4 and Zstd compression.
17+
Supported compression types are None, Gzip, Snappy, LZ4 and Zstd.
1818

1919
## Authentication and Encryption
2020

2121
You can use four types of security protocols to connect to your Kafka clusters:
22-
| Property name | Description |
23-
|----------------|-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
24-
| mTLS | encryption and authentication |
25-
| SASL_SSL | It combines two different security mechanisms - SASL (Simple Authentication and Security Layer) and SSL (Secure Sockets Layer) - to ensure both authentication and encryption are in place for data transmission. |
26-
| Kafka topic | A unit of your Kafka cluster you want to write events to. |
27-
| SASL_PLAINTEXT | standard authentication with username and password without encryption |
28-
| None | The serialization format (JSON, CSV, Avro, Parquet) of the incoming data stream. |
22+
23+
|Property name |Description |
24+
|----------|-----------|
25+
|mTLS |encryption and authentication |
26+
|SASL_SSL |It combines two different security mechanisms - SASL (Simple Authentication and Security Layer) and SSL (Secure Sockets Layer) - to ensure both authentication and encryption are in place for data transmission. |
27+
|Kafka topic |A unit of your Kafka cluster you want to write events to. |
28+
|SASL_PLAINTEXT |standard authentication with username and password without encryption |
29+
|None |The serialization format (JSON, CSV, Avro, Parquet) of the incoming data stream. |
2930

3031

3132
> [!IMPORTANT]
32-
> Confluent Cloud supports authenticating using API Keys, OAuth, or SAML single sign-on (SSO). Azure Stream Analytics do not currently support these authentication options. There will be a update in the near future to supporting authenticating to confluent cloud using API Keys.
33+
> Confluent Cloud supports authenticating using API Keys, OAuth, or SAML single sign-on (SSO). Azure Stream Analytics does not currently support these authentication options. There will be an update shortly to support authenticating to the confluent cloud using API Keys.
3334
>
3435
3536

3637
### Key Vault Integration
3738

3839
> [!NOTE]
39-
> When using truststore certificates with mTLS or SASL_SSL security protocols, you must have Azure KeyVault and managed identity configured for your Azure Stream Analytics job.
40+
> When using trust store certificates with mTLS or SASL_SSL security protocols, you must have Azure KeyVault and managed identity configured for your Azure Stream Analytics job.
4041
>
41-
Azure Stream Analytics integrates seamlessly with Azure Key Vault to access stored secrets needed for authentication and encryption when using mTLS or SASL_SSL security protocols. Your Azure Stream Analytics job connects to Azure Key Vault using managed identity to ensure secure connection and avoid exfiltration of secrets.
42+
Azure Stream Analytics integrates seamlessly with Azure Key Vault to access stored secrets needed for authentication and encryption when using mTLS or SASL_SSL security protocols. Your Azure Stream Analytics job connects to Azure Key Vault using managed identity to ensure a secure connection and avoid the exfiltration of secrets.
4243

43-
You can store the certificates as Key Vault certificate or Key Vault secret. Private keys are in PEM format.
44+
You can store the certificates as Key Vault certificates or Key Vault secrets. Private keys are in PEM format.
4445

4546
### Key Vault Integration
46-
When configuring your Azure Stream Analytics job to connect to your Kafka clusters, depending on your configuration, you may have to configure your job to be able to access your Kafka clusters which are behind a firewall or inside a virtual network. Please visit the Azure Stream Analytics VNET documentation to learn more about configuring private endpoints to access resources which are inside a virtual network or behind a firewall.
47+
When configuring your Azure Stream Analytics job to connect to your Kafka clusters, depending on your configuration, you may have to configure your job to be able to access your Kafka clusters, which are behind a firewall or inside a virtual network. You can visit the Azure Stream Analytics VNET documentation to learn more about configuring private endpoints to access resources that are inside a virtual network or behind a firewall.
4748

4849

4950
### Configuration
@@ -60,7 +61,7 @@ The following table lists the property names and their description for creating
6061
| Kafka event compression type | The compression type used for outgoing data stream, such as Gzip, Snappy, Lz4, Zstd or None. |
6162

6263
### Limitations
63-
* When configuring your Azure Stream Analytics jobs to use VNET/SWIFT, your job must be configured with a minimum of six (6) streaming units.
64+
* When configuring your Azure Stream Analytics jobs to use VNET/SWIFT, your job must be configured with at least six (6) streaming units.
6465
* When using mTLS or SASL_SSL with Azure Key Vault, you must convert your Java Key Store to PEM format.
6566
* The minimum version of Kafka you can configure Azure Stream Analytics to connect to is version 0.10.
6667

0 commit comments

Comments
 (0)