Skip to content

Conversation

@volkerhess2
Copy link
Contributor

@volkerhess2 volkerhess2 commented Jan 20, 2026

The current processing of single-byte values leads to different types and values of metadata. For example integers =< 9 are forwarded with their ascii value and of type number, values above 9 are forwarded as strings. A byte encoded 2 for example is forwarded as 50 because 50 is the ascii code of 2, while a 12 is forwarded as string of "12" like one would expect. We had to check this in the piplines and cast it to the correct value:

    mapping: |
      meta ce_e2eekeyversion = if metadata("ce_e2eekeyversion").type()  == "number" {
        "%c".format(metadata("ce_e2eekeyversion"))
      } else {
        metadata("ce_e2eekeyversion")
      }

This fix changes the kafka input to propagate every value as string.

@mmatczuk
Copy link
Collaborator

Thanks @volkerhess2!

@mmatczuk mmatczuk merged commit 97c93bb into redpanda-data:main Jan 21, 2026
5 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants