Skip to content

Conversation

@prwhelan
Copy link
Member

When the Transform System Index has been reindexed and aliased, we should check the Transform Update index against the alias when updating the Transform Config.


Verified locally:

  • Started container on 7.x
  • Created a Transform
  • Upgraded ES to 8.x
  • Used the Upgrade Assistant to migrate system indices
  • Updated the Transform

This change is for ES versions < 9.1 and will be different for 9.1+, since we will pull Index/Alias metadata via the ProjectResolver.

When the Transform System Index has been reindexed and aliased, we
should check the Transform Update index against the alias when updating
the Transform Config.
@prwhelan prwhelan added >bug :ml/Transform Transform Team:ML Meta label for the ML team auto-backport Automatically create backport pull requests when merged v9.0.0 v8.18.0 v8.18.1 v8.19.0 v9.0.1 labels Mar 13, 2025
@prwhelan prwhelan marked this pull request as ready for review March 13, 2025 19:17
@elasticsearchmachine
Copy link
Collaborator

Pinging @elastic/ml-core (Team:ML)

long lastCheckpoint = currentState.v1().getTransformState().getCheckpoint();

// if: the state is stored on the latest index, it does not need an update
if (currentState.v2().getIndex().equals(TransformInternalIndexConstants.LATEST_INDEX_VERSIONED_NAME)) {
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@prwhelan prwhelan enabled auto-merge (squash) March 13, 2025 21:03
@prwhelan prwhelan merged commit 4cf631a into elastic:9.0 Mar 13, 2025
16 checks passed
prwhelan added a commit to prwhelan/elasticsearch that referenced this pull request Mar 13, 2025
When the Transform System Index has been reindexed and aliased, we
should check the Transform Update index against the alias when updating
the Transform Config.
prwhelan added a commit to prwhelan/elasticsearch that referenced this pull request Mar 13, 2025
When the Transform System Index has been reindexed and aliased, we
should check the Transform Update index against the alias when updating
the Transform Config.
@elasticsearchmachine
Copy link
Collaborator

💚 Backport successful

Status Branch Result
8.18
8.x

elasticsearchmachine pushed a commit that referenced this pull request Mar 13, 2025
When the Transform System Index has been reindexed and aliased, we
should check the Transform Update index against the alias when updating
the Transform Config.
elasticsearchmachine pushed a commit that referenced this pull request Mar 13, 2025
When the Transform System Index has been reindexed and aliased, we
should check the Transform Update index against the alias when updating
the Transform Config.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

auto-backport Automatically create backport pull requests when merged >bug :ml/Transform Transform Team:ML Meta label for the ML team v8.18.0 v8.18.1 v8.19.0 v9.0.0 v9.0.1

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants