feat(parser): implemented a helper function Base64Encoded to decode base64 encoded payloads

[sdangol]

Summary

This PR adds a helper function which decodes a base64 encoded payload and parses the decoded payload with the schema passed to the function

Changes

Please provide a summary of what's being changed

• Added the helper function to decompress, decode and parse a base64 encoded payload
• Added tests for the helper function

Please add the issue number below, if no issue is present the PR might get blocked and not be reviewed

Issue number: closes #4412

---

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

Disclaimer: We value your time and bandwidth. As such, any pull requests created on non-triaged issues might not be successful.

[dreamorosi]

Should we use the new helper in the Kinsis schema here (packages/parser/src/schemas/kinesis.ts) similar to how we use the DynamoDB one in the DynamoDB schema here?

[sdangol]

@dreamorosi The dynamodb helper doesn't seem to be used in that schema, it's only referenced in the comments. It's using unmarshallDynamoDB. We would need an external schema to use that helper, right? Can we use it in the kinesis schema?

[dreamorosi]

If I understand the new helper correctly, you should be able to replace these lines here with something like this:

const KinesisDataStreamRecordPayload = z.object({
  kinesisSchemaVersion: z.string(),
  partitionKey: z.string(),
  sequenceNumber: z.string(),
  approximateArrivalTimestamp: z.number(),
  data: Base64Encoded(z.any()), // or z.unknown()
});

and also remove the decompress function and decoder references plus their imports.

[dreamorosi]

Thanks for working on this

[sonarqubecloud]

Quality Gate passed

Issues
0 New issues
0 Accepted issues

Measures
0 Security Hotspots
0.0% Coverage on New Code
0.0% Duplication on New Code

See analysis details on SonarQube Cloud