Skip to content

Commit 4c65ce1

Browse files
authored
Add additional big query fields in dbt_models table (#754)
* Add additional big query fields in dbt_models table * Update schema * Only cluster_by is bigquery specific field, rest are common across warehouses
1 parent 3437eef commit 4c65ce1

File tree

1 file changed

+6
-1
lines changed

1 file changed

+6
-1
lines changed

macros/edr/dbt_artifacts/upload_dbt_models.sql

Lines changed: 6 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -28,9 +28,11 @@
2828
('patch_path', 'string'),
2929
('generated_at', 'string'),
3030
('metadata_hash', 'string'),
31+
('unique_key', 'string'),
32+
('incremental_strategy', 'string'),
3133
] %}
3234
{% if target.type == "bigquery" or elementary.get_config_var("include_other_warehouse_specific_columns") %}
33-
{% do columns.extend([('bigquery_partition_by', 'string')]) %}
35+
{% do columns.extend([('bigquery_partition_by', 'string'), ('bigquery_cluster_by', 'string')]) %}
3436
{% endif %}
3537

3638
{% set dbt_models_empty_table_query = elementary.empty_table(columns) %}
@@ -80,7 +82,10 @@
8082
'path': node_dict.get('path'),
8183
'patch_path': node_dict.get('patch_path'),
8284
'generated_at': elementary.datetime_now_utc_as_string(),
85+
'unique_key': config_dict.get("unique_key"),
86+
'incremental_strategy': config_dict.get("incremental_strategy"),
8387
'bigquery_partition_by': config_dict.get("partition_by"),
88+
'bigquery_cluster_by': config_dict.get("cluster_by"),
8489
} %}
8590
{% do flatten_model_metadata_dict.update({"metadata_hash": elementary.get_artifact_metadata_hash(flatten_model_metadata_dict)}) %}
8691
{{ return(flatten_model_metadata_dict) }}

0 commit comments

Comments
 (0)