[CI] SearchServiceSingleNodeTests testSlicingBehaviourForParallelCollection failing

[elasticsearchmachine]

Build Scans:

• elasticsearch-periodic #7356 / release-tests
• elasticsearch-pull-request #65610 / checkpart1_release-tests
• elasticsearch-pull-request #65594 / checkpart1_release-tests
• elasticsearch-pull-request #65602 / checkpart1_release-tests
• elasticsearch-pull-request #65594 / checkpart1_release-tests
• elasticsearch-periodic #7349 / release-tests
• elasticsearch-periodic #7342 / release-tests
• elasticsearch-periodic #7328 / release-tests
• elasticsearch-periodic #7321 / release-tests
• elasticsearch-periodic #7314 / release-tests

Reproduction Line:

./gradlew ":server:test" --tests "org.elasticsearch.search.SearchServiceSingleNodeTests.testSlicingBehaviourForParallelCollection" -Dtests.seed=A5774D4729EE9273 -Dbuild.snapshot=false -Dtests.jvm.argline="-Dbuild.snapshot=false" -Dlicense.key=x-pack/license-tools/src/test/resources/public.key -Dtests.locale=szl -Dtests.timezone=PST8PDT -Druntime.java=24

Applicable branches:
main

Reproduces locally?:
N/A

Failure History:
See dashboard

Failure Message:

java.lang.AssertionError: null

Issue Reasons:

• [main] 6 consecutive failures in step release-tests
• [main] 4 consecutive failures in step checkpart1_release-tests
• [main] 10 failures in test testSlicingBehaviourForParallelCollection (3.3% fail rate in 304 executions)
• [main] 6 failures in step release-tests (100.0% fail rate in 6 executions)
• [main] 4 failures in step checkpart1_release-tests (100.0% fail rate in 4 executions)
• [main] 6 failures in pipeline elasticsearch-periodic (85.7% fail rate in 7 executions)
• [main] 3 failures in pipeline elasticsearch-pull-request (3.7% fail rate in 81 executions)

Note:
This issue was created using new test triage automation. Please report issues or feedback to es-delivery.

[elasticsearchmachine]

Pinging @elastic/es-search-foundations (Team:Search Foundations)

[elasticsearchmachine]

This has been muted on branch main

Mute Reasons:

• [main] 6 consecutive failures in step release-tests
• [main] 4 consecutive failures in step checkpart1_release-tests
• [main] 10 failures in test testSlicingBehaviourForParallelCollection (3.3% fail rate in 304 executions)
• [main] 6 failures in step release-tests (100.0% fail rate in 6 executions)
• [main] 4 failures in step checkpart1_release-tests (100.0% fail rate in 4 executions)
• [main] 6 failures in pipeline elasticsearch-periodic (85.7% fail rate in 7 executions)
• [main] 3 failures in pipeline elasticsearch-pull-request (3.7% fail rate in 81 executions)

Build Scans:

• elasticsearch-periodic #7356 / release-tests
• elasticsearch-pull-request #65610 / checkpart1_release-tests
• elasticsearch-pull-request #65594 / checkpart1_release-tests
• elasticsearch-pull-request #65602 / checkpart1_release-tests
• elasticsearch-pull-request #65594 / checkpart1_release-tests
• elasticsearch-periodic #7349 / release-tests
• elasticsearch-periodic #7342 / release-tests
• elasticsearch-periodic #7328 / release-tests
• elasticsearch-periodic #7321 / release-tests
• elasticsearch-periodic #7314 / release-tests

[cbuescher]

This reproduces on main, bisecting leads to fd2cc97 as the first failing commit.

Reducing the repro-line led me to this minimal set of arguments for reproduction:
./gradlew ":server:test" --tests "org.elasticsearch.search.SearchServiceSingleNodeTests.testSlicingBehaviourForParallelCollection" -Dtests.jvm.argline="-Dbuild.snapshot=false"

REPRODUCE WITH: ./gradlew ":server:test" --tests "org.elasticsearch.search.SearchServiceSingleNodeTests.testSlicingBehaviourForParallelCollection" -Dtests.seed=D604E89EDE77243A -Dbuild.snapshot=false -Dtests.jvm.argline="-Dbuild.snapshot=false" -Dlicense.key=x-pack/license-tools/src/test/resources/public.key -Dtests.locale=fr-PF -Dtests.timezone=Brazil/East -Druntime.java=24
  2> java.lang.AssertionError
        at __randomizedtesting.SeedInfo.seed([D604E89EDE77243A:8CBEE321974FA6BA]:0)
        at org.junit.Assert.fail(Assert.java:87)
        at org.junit.Assert.assertTrue(Assert.java:42)
        at org.junit.Assert.assertFalse(Assert.java:65)
        at org.junit.Assert.assertFalse(Assert.java:75)
        at org.elasticsearch.search.SearchServiceSingleNodeTests.testSlicingBehaviourForParallelCollection(SearchServiceSingleNodeTests.java:2828)`

But passes on the commit before. If I take out the -Dtests.jvm.argline="-Dbuild.snapshot=false" argument test passes, so it has something to do with that build.snapshot setting. I'll take a closer look.