Kafka Producers and Consumers in Rust with Protobuf examples

[hongbo-miao]

Thanks for @gklijs guide! I cannot find any demo online to use this library with Protobuf.

So I posted my Kafka Producers and Consumers in Rust with Protobuf demo code at

https://github.com/hongbo-miao/hongbomiao.com/tree/c60ab834456279df00ec55b1e2c7a245df82e277/hm-kafka/kafka-client/kafka-rust

Here is the command to create the schema for the corresponding code:

curl --location 'https://confluent-schema-registry.internal.hongbomiao.com/subjects/production.iot.motor.proto-value/versions' \
--header 'Content-Type: application/vnd.schemaregistry.v1+json' \
--data '{
    "schemaType": "PROTOBUF",
    "schema": "syntax = \"proto3\"; package production.iot; message Motor { optional string motor_id = 1; optional string timestamp = 2; optional double temperature1 = 3; optional double temperature2 = 4; optional double temperature3 = 5; optional double temperature4 = 6; optional double temperature5 = 7; }"
}'

AKHQ can also see Protobuf data correctly with corresponding schema in Confluent Schema Registry:

Redpanda Console can also see Protobuf data correctly with corresponding schema in Confluent Schema Registry:

Hopefully it can save people some time in future! ☺️

References

• https://github.com/confluentinc/confluent-kafka-python/blob/master/examples/protobuf_producer.py
• https://github.com/confluentinc/confluent-kafka-python/blob/master/examples/protobuf_consumer.py