Skip to content

Conversation

davidkyle
Copy link
Member

The test failed comparing an int to a long

Closes #132892

@davidkyle davidkyle added >test Issues or PRs that are addressing/adding tests :ml/Transform Transform v9.2.0 labels Aug 15, 2025
@elasticsearchmachine elasticsearchmachine added the Team:ML Meta label for the ML team label Aug 15, 2025
@elasticsearchmachine
Copy link
Collaborator

Pinging @elastic/ml-core (Team:ML)

@davidkyle davidkyle enabled auto-merge (squash) August 19, 2025 09:00

// do not allow in mixed clusters
if (TransportVersionUtils.isMinTransportVersionSameAsCurrent(state) == false) {
if (state.nodes().isMixedVersionCluster()) {
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The upgrade test failed because the original check for a mixed cluster isMinTransportVersionSameAsCurrent depends on the order in which the nodes are upgraded. If the master node this code runs on has not been upgraded yet the test will pass.

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice find

@davidkyle
Copy link
Member Author

The upgrade tests from 8.19.5 are failing because the transform upgrade code is fighting it out with the automatic system index upgrader.

First the system index migrator moves .transform-internal-007 to .transform-internal-007-reindexed-for-10

[2025-10-03T10:31:34,304][INFO ][o.e.s.t.SystemIndexMigrator] [v8.19.5-0] preparing to migrate old index [.transform-internal-007] from feature [transform] to new index [.transform-internal-007-reindexed-for-10]
[2025-10-03T10:31:34,305][INFO ][o.e.s.t.SystemIndexMigrator] [v8.19.5-0] migrating index [.transform-internal-007] from feature [transform] to new index [.transform-internal-007-reindexed-for-10]
[2025-10-03T10:31:34,305][INFO ][o.e.s.t.SystemIndexMigrator] [v8.19.5-0] creating new system index [.transform-internal-007-reindexed-for-10] from feature [transform]
[2025-10-03T10:31:34,312][INFO ][o.e.c.m.MetadataCreateIndexService] [v8.19.5-0] creating index [.transform-internal-007-reindexed-for-10] in project [default], cause [migrate-system-index], templates [], shards [1]/[1]
[2025-10-03T10:31:34,386][INFO ][o.e.c.m.MetadataIndexStateService] [v8.19.5-0] adding [index.blocks.write] block to indices [[.transform-internal-007/_WTe27ThRGS_FRhiiZKK3A]]
[2025-10-03T10:31:34,450][INFO ][o.e.c.m.MetadataIndexStateService] [v8.19.5-0] completed adding [index.blocks.write] block to indices [.transform-internal-007]
[2025-10-03T10:31:34,540][INFO ][o.e.c.m.MetadataDeleteIndexService] [v8.19.5-0] [.transform-internal-007/_WTe27ThRGS_FRhiiZKK3A] deleting index
[2025-10-03T10:31:34,586][INFO ][o.e.s.t.SystemIndexMigrator] [v8.19.5-0] Successfully migrated old index [.transform-internal-007] to new index [.transform-internal-007-reindexed-for-10] from feature [transform]

Then POST /_transform/_upgrade is called the final act of which is to delete old indices and because it does not recognise .transform-internal-007-reindexed-for-10 that is deleted too.

[2025-10-03T10:31:40,876][INFO ][o.e.x.t.a.TransportUpgradeTransformsAction] [v8.19.5-0] [mixed-complex-transform] Updated transform [NONE]
[2025-10-03T10:31:40,878][INFO ][o.e.c.m.MetadataDeleteIndexService] [v8.19.5-0] [.transform-internal-007-reindexed-for-10/m6txlkEcTjCPy1jRR3Rk_A] deleting index
/* The new system index has just been deleted !! */
[2025-10-03T10:31:40,918][INFO ][o.e.x.t.a.TransportUpgradeTransformsAction] [v8.19.5-0] Successfully upgraded all transforms, (updated: [0], no action [7])

@davidkyle
Copy link
Member Author

@prwhelan I've added 84329e4 to address the rolling upgrade failure described above. Please can you take another look


// do not allow in mixed clusters
if (TransportVersionUtils.isMinTransportVersionSameAsCurrent(state) == false) {
if (state.nodes().isMixedVersionCluster()) {
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice find

@davidkyle davidkyle merged commit 208ae57 into elastic:main Oct 8, 2025
34 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
:ml/Transform Transform Team:ML Meta label for the ML team >test Issues or PRs that are addressing/adding tests v9.3.0
Projects
None yet
Development

Successfully merging this pull request may close these issues.

TransformSurvivesUpgradeIT test testTransformRollingUpgrade failing
4 participants