Skip to content

Conversation

pmpailis
Copy link
Contributor

@pmpailis pmpailis commented Jan 14, 2025

In the retrievers-examples documentation, a test was failing due to unexpected ordering of the knn sub-retriever. In this PR, we ensure that we're using a flat indexer to ensure consistent and deterministic scoring and results for the tests.

Closes #119485 and #119155

@pmpailis pmpailis added >test Issues or PRs that are addressing/adding tests :Search Relevance/Ranking Scoring, rescoring, rank evaluation. v9.0.0 labels Jan 14, 2025
Copy link
Contributor

Documentation preview:

@elasticsearchmachine elasticsearchmachine added the Team:Search Relevance Meta label for the Search Relevance team in Elasticsearch label Jan 14, 2025
@elasticsearchmachine
Copy link
Collaborator

Pinging @elastic/es-search-relevance (Team:Search Relevance)

Copy link
Contributor

@john-wagster john-wagster left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@pmpailis
Copy link
Contributor Author

Thanks for the review @john-wagster ! Made a small additional change, would appreciate a fresh look whenever you have some time!

@pmpailis pmpailis requested a review from john-wagster January 16, 2025 10:24
@pmpailis pmpailis added the >docs General docs changes label Jan 16, 2025
@elasticsearchmachine
Copy link
Collaborator

Pinging @elastic/es-docs (Team:Docs)

@elasticsearchmachine elasticsearchmachine added the Team:Docs Meta label for docs team label Jan 16, 2025
@pmpailis pmpailis added v8.18.0 auto-backport Automatically create backport pull requests when merged labels Jan 21, 2025
Copy link
Contributor

@john-wagster john-wagster left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@pmpailis pmpailis merged commit 3e6b8bf into elastic:main Jan 21, 2025
15 checks passed
@elasticsearchmachine
Copy link
Collaborator

💔 Backport failed

Status Branch Result
8.x Commit could not be cherrypicked due to conflicts

You can use sqren/backport to manually backport by running backport --upstream elastic/elasticsearch --pr 120112

@pmpailis pmpailis deleted the fix_for_retriever_doc_test_failure branch May 27, 2025 03:48
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

auto-backport Automatically create backport pull requests when merged >docs General docs changes :Search Relevance/Ranking Scoring, rescoring, rank evaluation. Team:Docs Meta label for docs team Team:Search Relevance Meta label for the Search Relevance team in Elasticsearch >test Issues or PRs that are addressing/adding tests v8.17.0 v8.18.0 v9.0.0

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[CI] DocsClientYamlTestSuiteIT test {yaml=reference/search/search-your-data/retrievers-examples/line_99} failing

4 participants