KafkaError (Client config error: Unsupported value "snappy" for configuration property "compression.codec": snappy not enabled at buildtime compression.type snappy.)

[65001]

I'm setting up a StreamConsumer and I'm doing:

let consumer : StreamConsumer = ClientConfig::new()
.set("compression.type", "snappy")
.set("security.protocol", "SASL_PLAINTEXT")
.set("sasl.mechanisms", "SCRAM-SHA-512")
...
.create()
.unwrap()

I'm using version 0.36 with the following features: cmake-build, ssl, zstd and libz on Windows 11.

When I connect to the kafka broker, I'm seeing, "KafkaError (Client config error: Unsupported value "snappy" for configuration property "compression.codec": snappy not enabled at buildtime compression.type snappy.)

Can you help me figure out what's going on?

[65001]

This only seems to be occuring on Windows. When I ran the same code on Debian through a docker container it worked fine.

[chklauser]

With topics that let the producer control compression, the error message might look like this:

ERROR rdkafka::client: librdkafka: Global error: NotImplemented (Local: Not implemented): Decompression (codec 0x2) of message at 99758045 of 3446 bytes failed: Local: Not implemented

This, too, is on Windows.

rdkafka = { version = "0.36.2", default-features = false, features = ["cmake-build", "tokio", "ssl-vendored", "zstd", "libz-static"] }

Might be fixed by #586 🤞

If not, might be related to this open issue in the rdkafka upstream: confluentinc/librdkafka#4063 ("CMake does not define WITH_SNAPPY")