Skip to content

[BUG] Files generated per topic have fluctuating size instead of batchSize #493

@alpreu

Description

@alpreu

Describe the bug
The current sink implementation uses one batchSize summing the number of records of all topics together. This results in fluctuating real 'batch' sizes for each topic.

Expected behavior
The batchSize should be the minimum amount of records that are flushed for a topic.

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions