-
Notifications
You must be signed in to change notification settings - Fork 1
Open
Description
Trim sisiphys -> gaia kafka msgs down to:
step-startstep-complete- Compute next tasks to run and workflow complete/stalled/continues once per task completion, not per file data-complete.
- This will save time, esp. at scale, and make STEP COMPLETE appear in the log before WORKFLOW COMPLETE.
step-error-- puts the task in state:errortask-error-- puts the task in state:exception- What's the difference? Merge this with
step-erroror rename it tostep-exception. - Does Gaia need to distinguish
step-terminatedandstep-timeout?
- What's the difference? Merge this with
Check that Gaia and Sisyphus match up in all the Kafka messages, including when some part of a task fails.
Metadata
Metadata
Assignees
Labels
No labels