Skip to content

support databricks_compute for python models #1290

@maskebail

Description

@maskebail

Describe the feature

Support for databricks_compute compute configuration for python models so that http_path need not be configured in python model config
https://docs.getdbt.com/reference/resource-configs/databricks-configs#selecting-compute-per-model
in yml file, users can refer computes using http_path and the compute reference can be used per model; however, for python models, the databricks_compute is only used for SQL executions and the python model executes on default compute configured in yaml http_path or the users have to provide http_path hardcoded in the model dbt.config()
providing databricks_compute reference in the model config will make dbt python models simpler as it will allow setting compute per model without hardcoding http_path in the model config.

Describe alternatives you've considered

hardcode http_path in model config or use default http_path only.

Who will this benefit?

providing databricks_compute reference in the model config will make dbt python models simpler as it will allow setting compute per model without hardcoding http_path in the model config.

Are you interested in contributing this feature?

I can help with this feature.

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions