Skip to content

Conversation

@carlosdelest
Copy link
Member

@carlosdelest carlosdelest commented Jul 23, 2025

Allow updates from any index type to bbq_disk.

For the moment, no further restrictions have been applied to updating from bbq_disk to bbq_disk.

Closes #131461

@carlosdelest carlosdelest added >non-issue :Search Relevance/Vectors Vector search Team:Search Relevance Meta label for the Search Relevance team in Elasticsearch labels Jul 23, 2025
@carlosdelest carlosdelest marked this pull request as ready for review July 23, 2025 14:44
@elasticsearchmachine
Copy link
Collaborator

Pinging @elastic/es-search-relevance (Team:Search Relevance)

@carlosdelest carlosdelest requested review from a team, mayya-sharipova and tteofili July 23, 2025 14:45
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'm interested in other tests that we could do in YAML. I extended the ones we currently have to check that we can switch to bbq_disk.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

you might want to add "bbq_disk" (and perhaps "bbq_flat" and "bbq_hnsw"? with a random choice) to the updated cluster mapping in DenseVectorMappingUpdateIT.

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

you might want to add "bbq_disk" (and perhaps "bbq_flat" and "bbq_hnsw"? with a random choice) to the updated cluster mapping in DenseVectorMappingUpdateIT

Thought about that - but IIUC the mapping is applied before the upgrade, so I'm not sure if the mapping will be supported by the older node 🤔

I believe we can create a separate IT test for updating the mapping and index / search, similar to what the YAML test does, but in a randomized manner. That would add coverage to the YAML tests and probably remove some of them.

I think that should be done as a separate PR - but happy to work on that if y'all think is worhtwhile 👍

- method: POST
path: /_search
capabilities: [ optimized_scalar_quantization_bbq ]
capabilities: [ update_field_to_bbq_disk, dense_vector_updatable_bbq ]
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I changed some capabilities, as they were referring to /_mapping instead of /_search - we were skipping some tests due to the capabilities not being present in _search.

Copy link
Contributor

@tteofili tteofili left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM with a minor comment re tests

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

you might want to add "bbq_disk" (and perhaps "bbq_flat" and "bbq_hnsw"? with a random choice) to the updated cluster mapping in DenseVectorMappingUpdateIT.

Copy link
Contributor

@john-wagster john-wagster left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

you made it look easy; lgtm

@carlosdelest carlosdelest merged commit 3212ec2 into elastic:main Jul 23, 2025
33 checks passed
@carlosdelest
Copy link
Member Author

carlosdelest commented Jul 24, 2025

Added more comprehensive update tests in #131821

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

>non-issue :Search Relevance/Vectors Vector search Team:Search Relevance Meta label for the Search Relevance team in Elasticsearch v9.2.0

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Allow other index types to be updated to disk_bbq

4 participants