Skip to content

Semantic layer steps / job creator #61

@kristofferabs

Description

@kristofferabs

I like the structure of the semantic layer https://github.com/Mmodarre/acme_supermarkets_lhp_sample

Same as with pipelines this would benefit from the generator to combine the sdp flows with arbitrary semantic definitions.

  1. This could be a generated job that runs sql tasks
  2. if they are combined in a pipeline, they are added as a task in same job.
    Job steps would be
    "run sdp pipeline" 1->*
    "run sql tasks: create or replace gold view" 1->*
    "run sql tasks: create replace metric views"

This could be extended with other job tasks as well, but combining the semantic layer in the workflow is most valuable.

Metadata

Metadata

Assignees

No one assigned

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions