Add daily build pipeline for testing against next java EA version #133523

breskeby · 2025-08-26T07:38:29Z

This adds buildkite pipeline coverage to test against the next major EA builds.
This change includes a few changes to sort out some initial java 25 issues we face:

update asm to use a java 25 compatible version for plugin cli and plugin-scanner
tweak test infra to support java 25 (automatically adding add module support for vectors etc)

An example run can be seen https://buildkite.com/elastic/elasticsearch-periodic/builds?branch=add-periodic-ea-coverage-pipeline

The pipeline does currently not succeed due to an issue in painless I have not nailed down yet and consider out of the scope of this work.

elasticsearchmachine · 2025-08-26T07:38:54Z

Pinging @elastic/es-delivery (Team:Delivery)

rjernst

LGTM, one learning question

rjernst · 2025-08-26T12:45:08Z

.buildkite/pipelines/periodic-java-ea.template.yml

+  - group: bwc
+    steps: $BWC_STEPS
+  - label: concurrent-search-tests
+    command: .ci/scripts/run-gradle.sh -Druntime.java=$$JAVA_EA_VERSION -Dbwc.checkout.align=true -Dtests.jvm.argline=-Des.concurrent_search=true -Des.concurrent_search=true functionalTests


what does the double dollar sign mean in these files?

its required due to the fact that we want that variable to be interpolated at build runtime and not at pipeine upload. The buildkite docs explain that briefly here: https://buildkite.com/docs/agent/v3/cli-pipeline#environment-variable-substitution

JVerwolf

I had some questions, but I'll defer to others for approval as this is outside my area of expertise.

...-internal/src/main/java/org/elasticsearch/gradle/internal/precommit/ThirdPartyAuditTask.java

.buildkite/pipelines/periodic-java-ea.bwc.template.yml

mark-vieira · 2025-08-26T21:51:51Z

catalog-info.yaml

+    kind: Pipeline
+    metadata:
+      description: ":elasticsearch: Tests and checks that are run daily against the latest Java EA builds"
+      name: elasticsearch / periodic


We already have a pipeline with this name. Do these need to be unique?

mark-vieira · 2025-08-26T21:54:58Z

catalog-info.yaml

+apiVersion: backstage.io/v1alpha1
+kind: Resource
+metadata:
+  name: buildkite-pipeline-elasticsearch-periodic-java-ea


Why have this as a separate pipeline instead of just adding it to the existing JVM matrix testing pipeline?

my understanding is that we want more coverage than just what we cover in the JVM matrix. like the full periodic coverage

if we think the normal coverage is enough I'm happy to adjust this and just incorporate that in existing pipelines. // cc @JVerwolf @rjernst

This includes a few fixes in the codebase to support java 25: - Update asm in plugin-scanner - Update ESVectorizationProvider to support java 25 - Update asm in plugin-cli

elasticsearchmachine · 2025-08-29T13:54:39Z

💔 Backport failed

The backport operation could not be completed due to the following error:

There are no branches to backport to. Aborting.

You can use sqren/backport to manually backport by running backport --upstream elastic/elasticsearch --pr 133523

…astic#133523) This adds buildkite pipeline coverage to test against the next major EA builds. This change includes a few changes to sort out some initial java 25 issues we face: - update asm to use a java 25 compatible version for plugin cli and plugin-scanner - tweak test infra to support java 25 (automatically adding add module support for vectors etc)

…astic#133523) This adds buildkite pipeline coverage to test against the next major EA builds. This change includes a few changes to sort out some initial java 25 issues we face: - update asm to use a java 25 compatible version for plugin cli and plugin-scanner - tweak test infra to support java 25 (automatically adding add module support for vectors etc) (cherry picked from commit 97bea1f)

…33523) (#133876) This adds buildkite pipeline coverage to test against the next major EA builds. This change includes a few changes to sort out some initial java 25 issues we face: - update asm to use a java 25 compatible version for plugin cli and plugin-scanner - tweak test infra to support java 25 (automatically adding add module support for vectors etc) (cherry picked from commit 97bea1f)

…33523) (#133877) This adds buildkite pipeline coverage to test against the next major EA builds. This change includes a few changes to sort out some initial java 25 issues we face: - update asm to use a java 25 compatible version for plugin cli and plugin-scanner - tweak test infra to support java 25 (automatically adding add module support for vectors etc) (cherry picked from commit 97bea1f)

…astic#133523) This adds buildkite pipeline coverage to test against the next major EA builds. This change includes a few changes to sort out some initial java 25 issues we face: - update asm to use a java 25 compatible version for plugin cli and plugin-scanner - tweak test infra to support java 25 (automatically adding add module support for vectors etc) (cherry picked from commit 97bea1f) # Conflicts: # build-tools-internal/src/main/java/org/elasticsearch/gradle/internal/precommit/ThirdPartyAuditTask.java # libs/simdvec/src/main21/java/org/elasticsearch/simdvec/internal/vectorization/ESVectorizationProvider.java

…astic#133523) This adds buildkite pipeline coverage to test against the next major EA builds. This change includes a few changes to sort out some initial java 25 issues we face: - update asm to use a java 25 compatible version for plugin cli and plugin-scanner - tweak test infra to support java 25 (automatically adding add module support for vectors etc) (cherry picked from commit 97bea1f) # Conflicts: # build-tools-internal/src/main/java/org/elasticsearch/gradle/internal/precommit/ThirdPartyAuditTask.java

breskeby · 2025-09-03T16:34:05Z

💚 All backports created successfully

Status	Branch	Result
✅	8.19
✅	8.18

Questions ?

Please refer to the Backport tool documentation

…33523) (#134071) This adds buildkite pipeline coverage to test against the next major EA builds. This change includes a few changes to sort out some initial java 25 issues we face: - update asm to use a java 25 compatible version for plugin cli and plugin-scanner - tweak test infra to support java 25 (automatically adding add module support for vectors etc) (cherry picked from commit 97bea1f) # Conflicts: # build-tools-internal/src/main/java/org/elasticsearch/gradle/internal/precommit/ThirdPartyAuditTask.java

…33523) (#134070) This adds buildkite pipeline coverage to test against the next major EA builds. This change includes a few changes to sort out some initial java 25 issues we face: - update asm to use a java 25 compatible version for plugin cli and plugin-scanner - tweak test infra to support java 25 (automatically adding add module support for vectors etc) (cherry picked from commit 97bea1f) # Conflicts: # build-tools-internal/src/main/java/org/elasticsearch/gradle/internal/precommit/ThirdPartyAuditTask.java # libs/simdvec/src/main21/java/org/elasticsearch/simdvec/internal/vectorization/ESVectorizationProvider.java

…astic#133523) (elastic#134070) This adds buildkite pipeline coverage to test against the next major EA builds. This change includes a few changes to sort out some initial java 25 issues we face: - update asm to use a java 25 compatible version for plugin cli and plugin-scanner - tweak test infra to support java 25 (automatically adding add module support for vectors etc) (cherry picked from commit 97bea1f) # Conflicts: # build-tools-internal/src/main/java/org/elasticsearch/gradle/internal/precommit/ThirdPartyAuditTask.java # libs/simdvec/src/main21/java/org/elasticsearch/simdvec/internal/vectorization/ESVectorizationProvider.java

BASE=04ea11bf39e125a3a1a9f7c35e2854dd8f4ba3a5 HEAD=25ca0a65fb995b4d2535a24476d9cc4ae55469dd Branch=main

breskeby requested review from a team as code owners August 26, 2025 07:38

breskeby added >non-issue :Delivery/Build Build or test infrastructure Team:Delivery Meta label for Delivery team auto-backport Automatically create backport pull requests when merged v9.2.0 labels Aug 26, 2025

breskeby self-assigned this Aug 26, 2025

breskeby changed the title ~~WIP - Add periodic pipeline for testing java ea versions~~ Add daily build pipeline for testing against next java EA version Aug 26, 2025

breskeby requested a review from JVerwolf August 26, 2025 07:52

rjernst approved these changes Aug 26, 2025

View reviewed changes

JVerwolf reviewed Aug 26, 2025

View reviewed changes

...-internal/src/main/java/org/elasticsearch/gradle/internal/precommit/ThirdPartyAuditTask.java Show resolved Hide resolved

.buildkite/pipelines/periodic-java-ea.bwc.template.yml Show resolved Hide resolved

mark-vieira reviewed Aug 26, 2025

View reviewed changes

breskeby force-pushed the add-periodic-ea-coverage-pipeline branch 2 times, most recently from cb602a8 to 7d71fdb Compare August 28, 2025 16:59

breskeby requested review from JVerwolf and mark-vieira August 28, 2025 17:26

breskeby added 5 commits August 29, 2025 09:36

Add periodic pipeline for testing java ea versions

0905d44

This includes a few fixes in the codebase to support java 25: - Update asm in plugin-scanner - Update ESVectorizationProvider to support java 25 - Update asm in plugin-cli

fix pipeline name

74b212d

Add basic windows coverage

cc57a90

Update java pre-release version definition in periodic pipeline

37f604e

Fix comment

25ca0a6

breskeby force-pushed the add-periodic-ea-coverage-pipeline branch from 1765621 to 25ca0a6 Compare August 29, 2025 07:38

breskeby merged commit 97bea1f into elastic:main Aug 29, 2025
33 checks passed

elasticsearchmachine added the backport pending label Aug 29, 2025

breskeby mentioned this pull request Aug 30, 2025

[9.1] Add daily build pipeline for testing against next java EA version (#133523) #133876

Merged

breskeby mentioned this pull request Aug 30, 2025

[9.0] Add daily build pipeline for testing against next java EA version (#133523) #133877

Merged

breskeby mentioned this pull request Sep 3, 2025

[8.19] Add daily build pipeline for testing against next java EA version (#133523) #134070

Merged

breskeby mentioned this pull request Sep 3, 2025

[8.18] Add daily build pipeline for testing against next java EA version (#133523) #134071

Merged

phananh1010 added a commit to phananh1010/elasticsearch that referenced this pull request Sep 23, 2025

Mirror upstream elastic#133523 as single snapshot commit for AI review

df488a5

BASE=04ea11bf39e125a3a1a9f7c35e2854dd8f4ba3a5 HEAD=25ca0a65fb995b4d2535a24476d9cc4ae55469dd Branch=main

phananh1010 added a commit to phananh1010/elasticsearch that referenced this pull request Oct 2, 2025

Mirror upstream elastic#133523 as single snapshot commit for AI review

89fab85

BASE=04ea11bf39e125a3a1a9f7c35e2854dd8f4ba3a5 HEAD=25ca0a65fb995b4d2535a24476d9cc4ae55469dd Branch=main

phananh1010 added a commit to phananh1010/elasticsearch that referenced this pull request Oct 2, 2025

Mirror upstream elastic#133523 as single snapshot commit for AI review

1bf05ef

BASE=04ea11bf39e125a3a1a9f7c35e2854dd8f4ba3a5 HEAD=25ca0a65fb995b4d2535a24476d9cc4ae55469dd Branch=main

coderabbitai bot mentioned this pull request Oct 2, 2025

Mirror upstream elastic/elasticsearch#133523 for AI review (snapshot of HEAD tree) phananh1010/elasticsearch#91

Closed

phananh1010 added a commit to phananh1010/elasticsearch that referenced this pull request Oct 8, 2025

Mirror upstream elastic#133523 as single snapshot commit for AI review

8e50afb

BASE=04ea11bf39e125a3a1a9f7c35e2854dd8f4ba3a5 HEAD=25ca0a65fb995b4d2535a24476d9cc4ae55469dd Branch=main

phananh1010 added a commit to phananh1010/elasticsearch that referenced this pull request Oct 17, 2025

Mirror upstream elastic#133523 as single snapshot commit for AI review

39b9c49

BASE=04ea11bf39e125a3a1a9f7c35e2854dd8f4ba3a5 HEAD=25ca0a65fb995b4d2535a24476d9cc4ae55469dd Branch=main

phananh1010 added a commit to phananh1010/elasticsearch that referenced this pull request Oct 23, 2025

Mirror upstream elastic#133523 as single snapshot commit for AI review

cc01bd2

BASE=04ea11bf39e125a3a1a9f7c35e2854dd8f4ba3a5 HEAD=25ca0a65fb995b4d2535a24476d9cc4ae55469dd Branch=main

Add daily build pipeline for testing against next java EA version #133523

Add daily build pipeline for testing against next java EA version #133523

Uh oh!

Conversation

breskeby commented Aug 26, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

elasticsearchmachine commented Aug 26, 2025

Uh oh!

rjernst left a comment

Choose a reason for hiding this comment

Uh oh!

rjernst Aug 26, 2025

Choose a reason for hiding this comment

Uh oh!

breskeby Aug 26, 2025

Choose a reason for hiding this comment

Uh oh!

JVerwolf left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

mark-vieira Aug 26, 2025

Choose a reason for hiding this comment

Uh oh!

breskeby Aug 28, 2025

Choose a reason for hiding this comment

Uh oh!

mark-vieira Aug 26, 2025

Choose a reason for hiding this comment

Uh oh!

breskeby Aug 27, 2025

Choose a reason for hiding this comment

Uh oh!

breskeby Aug 27, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Uh oh!

elasticsearchmachine commented Aug 29, 2025

💔 Backport failed

Uh oh!

breskeby commented Sep 3, 2025

💚 All backports created successfully

Questions ?

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

5 participants

breskeby commented Aug 26, 2025 •

edited

Loading

breskeby Aug 27, 2025 •

edited

Loading