Skip to content

Conversation

@jimczi
Copy link
Contributor

@jimczi jimczi commented Dec 11, 2024

Backport

This will backport the following commits from main to 8.x:

This change introduces optional source filtering directly within source loaders (both synthetic and stored).
The main benefit is seen in synthetic source loaders, as synthetic fields are stored independently.
By filtering while loading the synthetic source, generating the source becomes linear in the number of fields that match the filter.

This update also modifies the get document API to apply source filters earlier—directly through the source loader.
The search API, however, is not affected in this change, since the loaded source is still used by other features (e.g., highlighting, fields, nested hits),
and source filtering is always applied as the final step.
A follow-up will be required to ensure careful handling of all search-related scenarios.
@jimczi jimczi added backport auto-merge-without-approval Automatically merge pull request when CI checks pass (NB doesn't wait for reviews!) :StorageEngine/Mapping The storage related side of mappings v8.18.0 labels Dec 11, 2024
@elasticsearchmachine elasticsearchmachine merged commit aa29a57 into elastic:8.x Dec 11, 2024
15 checks passed
@jimczi jimczi deleted the backport_113827_8x branch December 11, 2024 14:33
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

auto-merge-without-approval Automatically merge pull request when CI checks pass (NB doesn't wait for reviews!) backport :StorageEngine/Mapping The storage related side of mappings v8.18.0

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants