Feature request: Support Confluent producers in new Kafka utility

[leandrodamascena]

Use case

Only for protobuf:

According to the wire format of the Confluent serializers message-indices are injected as additional bytes after magic bytes and schema id:

magic-byte, schema-id, message-indexes, protobuf-payload

We need to strip these message-indexes before attempting to parse the data using the plain Google protobuf library if they are present.

See: https://docs.confluent.io/platform/current/schema-registry/fundamentals/serdes-develop/index.html#wire-format

Solution/User Experience

Add support for confluent producers.

Alternative solutions

Acknowledgment

• This feature request meets Powertools for AWS Lambda (Python) Tenets
• Should this be considered in other Powertools for AWS Lambda languages? i.e. Java, TypeScript, and .NET

[leandrodamascena]

Close via: #6833

[github-actions]

⚠️COMMENT VISIBILITY WARNING⚠️

This issue is now closed. Please be mindful that future comments are hard for our team to see.

If you need more assistance, please either tag a team member or open a new issue that references this one.

If you wish to keep having a conversation with other community members under this issue feel free to do so.

[github-actions]

This is now released under 3.15.1 version!