Skip to content

Mark test_bad_queries and test_good_queries as ignored#2774

Merged
CommanderStorm merged 2 commits intomainfrom
copilot/ignore-flaky-test-queries
Mar 12, 2026
Merged

Mark test_bad_queries and test_good_queries as ignored#2774
CommanderStorm merged 2 commits intomainfrom
copilot/ignore-flaky-test-queries

Conversation

Copy link
Copy Markdown
Contributor

Copilot AI commented Mar 12, 2026

test_good_queries and test_bad_queries are flaky over time and provide low signal, so they should not run by default.

Proposed Change(s)

  • Added #[ignore = "flaky over time and low signal"] to both test_good_queries and test_bad_queries in server/src/search_executor/mod.rs

Tests can still be run explicitly via cargo test -- --ignored when needed.

Checklist

  • Documentation
    • I have updated the documentation
    • No need to update the documentation

💬 We'd love your input! Share your thoughts on Copilot coding agent in our 2 minute survey.

Co-authored-by: CommanderStorm <26258709+CommanderStorm@users.noreply.github.com>
Copilot AI changed the title [WIP] Ignore bad and good queries tests due to flakiness Mark test_bad_queries and test_good_queries as ignored Mar 12, 2026
@CommanderStorm CommanderStorm marked this pull request as ready for review March 12, 2026 07:01
Copilot AI review requested due to automatic review settings March 12, 2026 07:01
@CommanderStorm CommanderStorm enabled auto-merge (squash) March 12, 2026 07:01
Copy link
Copy Markdown
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This PR disables two Meilisearch-backed query-quality tests in the server search executor by marking them as ignored, due to flakiness.

Changes:

  • Mark test_good_queries as ignored with a flakiness note.
  • Mark test_bad_queries as ignored with a flakiness note.

Comment thread server/src/search_executor/mod.rs
Comment thread server/src/search_executor/mod.rs
@CommanderStorm CommanderStorm merged commit 7d57331 into main Mar 12, 2026
39 checks passed
@CommanderStorm CommanderStorm deleted the copilot/ignore-flaky-test-queries branch March 12, 2026 07:27
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants