Skip to content

Adaptive Hybrid Synthetic Source for Pruned _source Fields #133337

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
Rassyan wants to merge 2 commits into
base: main
Choose a base branch
from
Open

Adaptive Hybrid Synthetic Source for Pruned _source Fields #133337

Rassyan wants to merge 2 commits into from

Conversation

@Rassyan
Copy link
Contributor

@Rassyan Rassyan commented Aug 21, 2025

🌟 Problem Statement

Issue: #133203

🚧 Next Steps

  • Core hybrid synthetic source mode for vectors
  • Appropriate renaming and refactoring
  • Support for other field types

Rassyan added 2 commits August 21, 2025 22:46
@Rassyan
Add failing test: reindex loses pruned vector fields
b0b9b66
@Rassyan
POC - Adaptive hybrid synthetic source reconstruction for pruned vect…
3173fed 
…or fields

FAST IMPLEMENTATION focusing only on vector fields, implements the first stage of adaptive hybrid source:
Automatically reconstructs VECTOR fields from doc_values during:
   - Reindex operations
   - Update/update_by_query
   - Get/search requests

Resolves failing test: testReindexAutoIncludeVectors
@elasticsearchmachine elasticsearchmachine added v9.2.0 needs:triage Requires assignment of a team area label external-contributor Pull request authored by a developer outside the Elasticsearch team labels Aug 21, 2025
@Rassyan Rassyan mentioned this pull request Aug 22, 2025
Open
@szybia szybia added :Search Relevance/Vectors Vector search and removed needs:triage Requires assignment of a team area label labels Aug 22, 2025
@elasticsearchmachine elasticsearchmachine added the Team:Search Relevance Meta label for the Search Relevance team in Elasticsearch label Aug 22, 2025
@elasticsearchmachine
Copy link
Collaborator

elasticsearchmachine commented Aug 22, 2025

Pinging @elastic/es-search-relevance (Team:Search Relevance)

@Rassyan Rassyan mentioned this pull request Aug 22, 2025
Open
@carlosdelest carlosdelest added :StorageEngine/Mapping The storage related side of mappings and removed Team:Search Relevance Meta label for the Search Relevance team in Elasticsearch labels Oct 3, 2025
@elasticsearchmachine elasticsearchmachine added Team:StorageEngine Team:Search Relevance Meta label for the Search Relevance team in Elasticsearch labels Oct 3, 2025
@elasticsearchmachine
Copy link
Collaborator

elasticsearchmachine commented Oct 3, 2025

Pinging @elastic/es-storage-engine (Team:StorageEngine)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

external-contributor Pull request authored by a developer outside the Elasticsearch team :Search Relevance/Vectors Vector search :StorageEngine/Mapping The storage related side of mappings Team:Search Relevance Meta label for the Search Relevance team in Elasticsearch Team:StorageEngine v9.3.0

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

4 participants

@Rassyan @elasticsearchmachine @carlosdelest @szybia