Skip to content

Conversation

@Mikep86
Copy link
Contributor

@Mikep86 Mikep86 commented Apr 9, 2025

Adds a rolling upgrade test suite for basic semantic_text functionality. Covers indexing docs, querying, and highlighting.

I chose to go with an integration test approach because we cannot perform inference via the Inference API in this context (it depends on a mock inference services plugin that we cannot load). Instead, we depend on passing in pre-computed inference results at index and query time. It's much easier to do this in an integration test where we can:

  • Use pre-existing test util methods
  • Write helper methods to handle request generation

@Mikep86 Mikep86 added >test Issues or PRs that are addressing/adding tests auto-backport Automatically create backport pull requests when merged :SearchOrg/Relevance Label for the Search (solution/org) Relevance team v8.19.0 v9.1.0 labels Apr 9, 2025
Copy link
Member

@kderusso kderusso left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice start!

@Mikep86 Mikep86 marked this pull request as ready for review May 1, 2025 20:08
@elasticsearchmachine
Copy link
Collaborator

Pinging @elastic/search-eng (Team:SearchOrg)

@elasticsearchmachine
Copy link
Collaborator

Pinging @elastic/search-relevance (Team:Search - Relevance)

Copy link
Member

@kderusso kderusso left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Given the limitations on mocking this looks good to me!

Copy link
Contributor

@Samiul-TheSoccerFan Samiul-TheSoccerFan left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nice work 👏

@Mikep86
Copy link
Contributor Author

Mikep86 commented May 5, 2025

The 8.19 tests are failing because the semantic text chunking config transport version needs to be ported to main: #127722

@Mikep86
Copy link
Contributor Author

Mikep86 commented May 5, 2025

@elasticmachine update branch

@Mikep86 Mikep86 merged commit 2eb9fab into elastic:main May 6, 2025
17 checks passed
Mikep86 added a commit to Mikep86/elasticsearch that referenced this pull request May 6, 2025
@elasticsearchmachine
Copy link
Collaborator

💚 Backport successful

Status Branch Result
8.19

elasticsearchmachine pushed a commit that referenced this pull request May 7, 2025
* Semantic Text Rolling Upgrade Tests (#126548)

* Fix test failures

---------

Co-authored-by: Elastic Machine <[email protected]>
@Mikep86
Copy link
Contributor Author

Mikep86 commented May 7, 2025

💚 All backports created successfully

Status Branch Result
9.0

Questions ?

Please refer to the Backport tool documentation

Mikep86 added a commit to Mikep86/elasticsearch that referenced this pull request May 7, 2025
(cherry picked from commit 2eb9fab)

# Conflicts:
#	x-pack/plugin/inference/src/test/java/org/elasticsearch/xpack/inference/model/TestModel.java
Mikep86 added a commit to Mikep86/elasticsearch that referenced this pull request May 7, 2025
…127748)

* Semantic Text Rolling Upgrade Tests (elastic#126548)

* Fix test failures

---------

Co-authored-by: Elastic Machine <[email protected]>
(cherry picked from commit a3a64ea)

# Conflicts:
#	x-pack/plugin/inference/src/test/java/org/elasticsearch/xpack/inference/model/TestModel.java
Mikep86 added a commit to Mikep86/elasticsearch that referenced this pull request May 7, 2025
…127748)

* Semantic Text Rolling Upgrade Tests (elastic#126548)

* Fix test failures

---------

Co-authored-by: Elastic Machine <[email protected]>
(cherry picked from commit a3a64ea)

# Conflicts:
#	x-pack/plugin/inference/src/test/java/org/elasticsearch/xpack/inference/model/TestModel.java
ywangd pushed a commit to ywangd/elasticsearch that referenced this pull request May 9, 2025
jfreden pushed a commit to jfreden/elasticsearch that referenced this pull request May 12, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

auto-backport Automatically create backport pull requests when merged :SearchOrg/Relevance Label for the Search (solution/org) Relevance team >test Issues or PRs that are addressing/adding tests v8.19.0 v9.1.0

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants