Skip to content

Shoveled events can be written out of order #61

@condron

Description

@condron

Here are some of the details of the case where we saw this happen.

  1. We were load testing the shovel by shoveling four separate clusters into a single one at the same time.
  2. The batch size for each Shoveler was 1000.
  3. Each shovel resulted in about 4-5GB of events migrating over, for about 18GB shoveled.
  4. Looking through the generated logs, the events seem to be sent (appended) in the correct order, so I'm not certain what is causing the wrong order we saw, whether the sending or receiving end.

Metadata

Metadata

Assignees

Labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions