[CI] EsqlSpecIT class failing

[elasticsearchmachine]

Build Scans:

• elasticsearch-periodic-platform-support #6754 / ubuntu-2004-aarch64_checkpart3_platform-support-arm
• elasticsearch-periodic-platform-support #6733 / ubuntu-2404-aarch64_checkpart3_platform-support-arm

Reproduction Line:

undefined

Applicable branches:
8.18

Reproduces locally?:
N/A

Failure History:
See dashboard

Failure Message:

undefined

Issue Reasons:

• [8.18] 2 failures in class org.elasticsearch.xpack.esql.qa.multi_node.EsqlSpecIT (1.7% fail rate in 119 executions)
• [8.18] 2 failures in pipeline elasticsearch-periodic-platform-support (50.0% fail rate in 4 executions)

Note:
This issue was created using new test triage automation. Please report issues or feedback to es-delivery.

[elasticsearchmachine]

Pinging @elastic/es-analytical-engine (Team:Analytics)

[alex-spies]

I believe this is the same as #120948.

The latter should've been fixed by #121107. @dnhatn , do you have an idea what could cause the seqNo [0] was processed twice in generation [2] errors to still show up?

The first build scan has:

[2025-01-31T16:17:02,787][ERROR][o.e.b.ElasticsearchUncaughtExceptionHandler] [test-cluster-0] fatal error in thread [elasticsearch[test-cluster-0][generic][T#3]], exiting java.lang.AssertionError: java.lang.AssertionError: seqNo [0] was processed twice in generation [2], with different data. prvOp [Index{id='1', seqNo=0, primaryTerm=1, version=1, autoGeneratedIdTimestamp=-1}], newOp [Index{id='1', seqNo=0, primaryTerm=1, version=1, autoGeneratedIdTimestamp=-1}]	

The second build scan has this error:

[2025-01-28T14:55:50,156][ERROR][o.e.b.ElasticsearchUncaughtExceptionHandler] [test-cluster-1] fatal error in thread [elasticsearch[test-cluster-1][generic][T#21]], exiting java.lang.AssertionError: java.lang.AssertionError: seqNo [0] was processed twice in generation [2], with different data. prvOp [Index{id='1', seqNo=0, primaryTerm=1, version=1, autoGeneratedIdTimestamp=-1}], newOp [Index{id='1', seqNo=0, primaryTerm=1, version=1, autoGeneratedIdTimestamp=-1}]	

[elasticsearchmachine]

This has been muted on branch main

Mute Reasons:

• [main] 5 failures in class org.elasticsearch.xpack.esql.qa.multi_node.EsqlSpecIT (0.7% fail rate in 676 executions)
• [main] 4 failures in step part-3 (1.5% fail rate in 259 executions)
• [main] 3 failures in pipeline elasticsearch-pull-request (1.2% fail rate in 257 executions)

Build Scans:

• elasticsearch-periodic-platform-support #6135 / rhel-8_platform-support-unix
• elasticsearch-pull-request #54146 / part-3
• elasticsearch-pull-request #54034 / part-3
• elasticsearch-pull-request #54034 / part-3
• elasticsearch-pull-request #53883 / part-3