-
Notifications
You must be signed in to change notification settings - Fork 26
Closed
Description
Some of our data sources read in other pop./topic data from our bigquery before writing that topic to bigquery. We should indicate within each new dag workflow these prerequisites; easiest would be comments but even more helpful would be some type of specific error message if a topic pipeline fails because the upstream dependencies bigquery don't exist (indicating the dev must run those first)
Here is a flowchart indicating which needs which:
https://healthequitytracker.notion.site/DAG-dependencies-1ba852c1676e80eface1f3c0155b810d?pvs=4
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
No labels