Who is this feature for?

Table Topic

What problem are they facing today?

The existing business is using ProtoBuf for serialization and sending Kafka Records. There are downstream systems that deserialize byte[] and then perform business logic processing.

It is expected to import data into Iceberg with the help of Table Topic. However, Table Topic requires that only Schema messages can be sent. This means that both the existing Producer and Consumer must be modified to be compatible with the old and new data formats.

Why is solving this impactful?

Proposed solution

• Set the topic schema by topic config or AutoMQ directly fetch the schema from schema registry.

Additional notes

No response