Skip to content

Conversation

@martijnvg
Copy link
Member

This is no longer needed as offsets of leaf array fields are stored in a doc values offset field that is controlled by field mapper.

This is no longer needed as offsets of leaf array fields are stored in a doc values offset field that is controlled by field mapper.
@martijnvg martijnvg added >non-issue :StorageEngine/Mapping The storage related side of mappings labels Aug 11, 2025
@martijnvg martijnvg marked this pull request as ready for review August 11, 2025 14:46
@martijnvg martijnvg requested a review from kkrik-es August 11, 2025 14:46
@elasticsearchmachine
Copy link
Collaborator

Pinging @elastic/es-storage-engine (Team:StorageEngine)

@jordan-powers
Copy link
Contributor

Will this create issues with BWC since indices with IndexVersion <= SYNTHETIC_SOURCE_STORE_ARRAYS_NATIVELY_NUMBER(9_016_0_00) still use ignored source instead of recording offsets?

@martijnvg
Copy link
Member Author

Will this create issues with BWC since indices with IndexVersion <= SYNTHETIC_SOURCE_STORE_ARRAYS_NATIVELY_NUMBER(9_016_0_00) still use ignored source instead of recording offsets?

What happens is the with this change indices created before that version will just no longer use this optimization. In that case they will fallback using ignored source even if the array has just one element. I don't think this change will break anything, just disables the optimization for indices created before that version. Just to be sure I will check whether this bwc scenario is tested and if not I will add a test.

@jordan-powers
Copy link
Contributor

Ah, didn't realize this was just an optimization being removed. This makes sense then, thanks!

@martijnvg martijnvg added the test-full-bwc Trigger full BWC version matrix tests label Aug 16, 2025
@martijnvg martijnvg enabled auto-merge (squash) August 18, 2025 06:02
@martijnvg martijnvg merged commit f63e9e5 into elastic:main Aug 18, 2025
29 checks passed
javanna pushed a commit to javanna/elasticsearch that referenced this pull request Aug 18, 2025
)

This is no longer needed as offsets of leaf array fields are stored in a doc values offset field that is controlled by field mapper.
rjernst pushed a commit to rjernst/elasticsearch that referenced this pull request Aug 18, 2025
)

This is no longer needed as offsets of leaf array fields are stored in a doc values offset field that is controlled by field mapper.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

>non-issue :StorageEngine/Mapping The storage related side of mappings Team:StorageEngine test-full-bwc Trigger full BWC version matrix tests v9.2.0

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants