Allow data stream reindex tasks to be re-run after completion #122510
Conversation
lukewhiting
force-pushed
the
es-10851-allow-reindex-when-completed
branch
from
976e6d5 to
77b4b93
Compare
lukewhiting
force-pushed
the
es-10851-allow-reindex-when-completed
branch
from
77b4b93 to
7c1b83b
Compare
lukewhiting
added
>non-issue
:Data Management/Data streams
lukewhiting
added
the
auto-backport
elasticsearchmachine
added
the
Team:Data Management
|
Pinging @elastic/es-data-management (Team:Data Management) |
parkertimmins
left a comment
parkertimmins
left a comment
There was a problem hiding this comment.
Looks correct to me. But Keith knows this code better, so let's wait to merge until he has taken a look.
|
Looks good to me, but can you add a note about it at https://github.com/elastic/elasticsearch/blob/main/docs/reference/migration/apis/data-stream-reindex.asciidoc?plain=1#L25? |
Ignoring this so it can be picked up in backport. Will open the relevant docs repo issue once this is merged. |
|
Warning It looks like this PR modifies one or more |
Co-authored-by: Keith Massey <[email protected]>
|
Warning It looks like this PR modifies one or more |
|
Warning It looks like this PR modifies one or more |
…c#122510) * Allow data stream reindex tasks to be re-run after completion * Docs update * Update docs/reference/migration/apis/data-stream-reindex.asciidoc Co-authored-by: Keith Massey <[email protected]> --------- Co-authored-by: Keith Massey <[email protected]>
…c#122510) * Allow data stream reindex tasks to be re-run after completion * Docs update * Update docs/reference/migration/apis/data-stream-reindex.asciidoc Co-authored-by: Keith Massey <[email protected]> --------- Co-authored-by: Keith Massey <[email protected]>
… (#123035) * Allow data stream reindex tasks to be re-run after completion * Docs update * Update docs/reference/migration/apis/data-stream-reindex.asciidoc --------- Co-authored-by: Keith Massey <[email protected]>
… (#123037) * Allow data stream reindex tasks to be re-run after completion * Docs update * Update docs/reference/migration/apis/data-stream-reindex.asciidoc --------- Co-authored-by: Keith Massey <[email protected]>
… (#123036) * Allow data stream reindex tasks to be re-run after completion * Docs update * Update docs/reference/migration/apis/data-stream-reindex.asciidoc --------- Co-authored-by: Keith Massey <[email protected]>
4 participants
This PR modified the Reindex Datastreams endpoint to allow it to correctly handle restarting a reindex job in the 24 hours after it completes.
Currently, because we cache the job for 24 hours after completion, you can't start a new reindex for the same datastream as it will throw an exception due to the duplicated persistent task ID.
The PR updates that behaviour so that the endpoint now checks for an existing task for that datastream, if it finds one, it check the status. If still running, fail as before but if complete then remove that task from the cache and start a new task.