We can investigate:
- StepFunctions support for submitting and monitoring
- A plain lambda on a schedule, trying to tie running jobs to state in Spark
- Any other potential options
For this issue we just want to spend a little time planning what we could do.
We can investigate:
For this issue we just want to spend a little time planning what we could do.