Skip to content

Conversation

@martijnvg
Copy link
Member

@martijnvg martijnvg commented Aug 8, 2025

Be more strict about not finding a metadata entry based on field info number.
If this were to happen, then this can cause issues in doc value consumer later.
An example of such a failure is what is fixed via #132597, here with shrinking
the local segment and merged field numbers were not aligned causing serious
merge errors in the tsdb doc value consumer. Currently such an issue shouldn't
occur anymore.

Be more strict about not finding a metadata entry based on field info number.

If this were to happen, then this can cause issues in doc value consumer. However as far as I understand it, the field info number should stay consistent.
Copy link
Contributor

@jordan-powers jordan-powers left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Makes sense to me, thanks Martijn!

@martijnvg martijnvg marked this pull request as ready for review August 11, 2025 01:29
@elasticsearchmachine
Copy link
Collaborator

Pinging @elastic/es-storage-engine (Team:StorageEngine)

@martijnvg
Copy link
Member Author

Thanks @jordan-powers and @dnhatn for the reviews!

@martijnvg martijnvg merged commit 25e4a06 into elastic:main Aug 11, 2025
33 checks passed
martijnvg added a commit to martijnvg/elasticsearch that referenced this pull request Aug 14, 2025
Be more strict about not finding a metadata entry based on field info number.
If this were to happen, then this can cause issues in doc value consumer later.
An example of such a failure is what is fixed via elastic#132597, here with shrinking
the local segment and merged field numbers were not aligned causing serious
merge errors in the tsdb doc value consumer. Currently such an issue shouldn't
occur anymore.
martijnvg added a commit to martijnvg/elasticsearch that referenced this pull request Aug 14, 2025
Be more strict about not finding a metadata entry based on field info number.
If this were to happen, then this can cause issues in doc value consumer later.
An example of such a failure is what is fixed via elastic#132597, here with shrinking
the local segment and merged field numbers were not aligned causing serious
merge errors in the tsdb doc value consumer. Currently such an issue shouldn't
occur anymore.
elasticsearchmachine pushed a commit that referenced this pull request Aug 14, 2025
Be more strict about not finding a metadata entry based on field info number.
If this were to happen, then this can cause issues in doc value consumer later.
An example of such a failure is what is fixed via #132597, here with shrinking
the local segment and merged field numbers were not aligned causing serious
merge errors in the tsdb doc value consumer. Currently such an issue shouldn't
occur anymore.
elasticsearchmachine pushed a commit that referenced this pull request Aug 18, 2025
Be more strict about not finding a metadata entry based on field info number.
If this were to happen, then this can cause issues in doc value consumer later.
An example of such a failure is what is fixed via #132597, here with shrinking
the local segment and merged field numbers were not aligned causing serious
merge errors in the tsdb doc value consumer. Currently such an issue shouldn't
occur anymore.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants