Skip to content

Commit 9ba2e65

Browse files
committed
adding Kafka compression docs
1 parent f0d5e06 commit 9ba2e65

File tree

2 files changed

+10
-2
lines changed

2 files changed

+10
-2
lines changed

articles/event-hubs/apache-kafka-troubleshooting-guide.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -25,9 +25,9 @@ You may see consumers not getting any records and constantly rebalancing. In thi
2525
- If your configuration matches those recommended values, and you're still seeing constant rebalancing, feel free to open up an issue (make sure to include your entire configuration in the issue so that we can help debug)!
2626

2727
## Compression/Message format version issue
28-
Kafka supports compression, and Event Hubs for Kafka currently doesn't. Errors that mention a message-format version (for example, `The message format version on the broker does not support the request.`) are caused when a client tries to send compressed Kafka messages to our brokers.
28+
Event Hubs for Kafka currently supports only `gzip` compression algorithm. If any other algorithm is used, client applications will see a message-format version error (for example, `The message format version on the broker does not support the request.`).
2929

30-
If compressed data is necessary, compressing your data before sending it to the brokers and decompressing after receiving is a valid workaround. The message body is just a byte array to the service, so client-side compression/decompression won't cause any issues.
30+
If an unsupported compression algorithm needs to be used, compressing your data with that specific algorithm before sending it to the brokers and decompressing after receiving is a valid workaround. The message body is just a byte array to the service, so client-side compression/decompression won't cause any issues.
3131

3232
## UnknownServerException
3333
You may receive an UnknownServerException from Kafka client libraries similar to the following example:

articles/event-hubs/azure-event-hubs-kafka-overview.md

Lines changed: 8 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -31,6 +31,14 @@ Conceptually, Kafka and Event Hubs are very similar. They're both partitioned lo
3131
| Consumer Group | Consumer Group |
3232
| Offset | Offset|
3333

34+
## Apache Kafka features supported on Azure Event Hubs
35+
36+
### Compression
37+
38+
The client-side [compression](https://cwiki.apache.org/confluence/display/KAFKA/Compression) feature in Apache Kafka clients conserves compute resources and bandwidth by compressing a batch of multiple messages into a single message on the producer side and decompressing the batch on the consumer side. The Apache Kafka broker treats the batch as a special message.
39+
40+
Kafka producer application developers can enable message compression by setting the compression.type property. Azure Event Hubs currently supports `gzip` compression.
41+
3442
## Key differences between Apache Kafka and Azure Event Hubs
3543

3644
While [Apache Kafka](https://kafka.apache.org/) is software you typically need to install and operate, Event Hubs is a fully managed, cloud-native service. There are no servers, disks, or networks to manage and monitor and no brokers to consider or configure, ever. You create a namespace, which is an endpoint with a fully qualified domain name, and then you create Event Hubs (topics) within that namespace.

0 commit comments

Comments
 (0)