Skip to content

Should we indicate DAG dependencies #4180

@benhammondmusic

Description

@benhammondmusic

Some of our data sources read in other pop./topic data from our bigquery before writing that topic to bigquery. We should indicate within each new dag workflow these prerequisites; easiest would be comments but even more helpful would be some type of specific error message if a topic pipeline fails because the upstream dependencies bigquery don't exist (indicating the dev must run those first)

Here is a flowchart indicating which needs which:

https://healthequitytracker.notion.site/DAG-dependencies-1ba852c1676e80eface1f3c0155b810d?pvs=4

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions