Skip to content
This repository was archived by the owner on Sep 2, 2025. It is now read-only.

Conversation

@borjavb
Copy link
Contributor

@borjavb borjavb commented Nov 27, 2024

resolves dbt-labs/dbt-adapters#533

Problem

Bigquery has now support for native iceberg tables as a new type of materialisation.

Solution

Very naive approximation on how this could look like. We support both incrementality + the desired table format.

{{ config(
    materialized="incremental",
    table_format="iceberg",
    base_location = "location",
    bl_connection = "biglake_connection"
)
}}

bl_connection could be a config a dbt_project level.

Testing is not possible for now because we would need to create all the connections and everything in the dbt enviroment for CI/CD

Checklist

  • I have read the contributing guide and understand what's expected of me
  • I have run this code in development and it appears to resolve the stated issue
  • This PR includes tests, or tests are not required/relevant for this PR
  • This PR has no interface changes (e.g. macros, cli, logs, json artifacts, config files, adapter interface, etc) or this PR has already received feedback and approval from Product or DX

@borjavb borjavb requested a review from a team as a code owner November 27, 2024 23:31
@cla-bot cla-bot bot added the cla:yes label Nov 27, 2024
@vrishin-bolt
Copy link

When are we planning to merge this to prod?

@borjavb
Copy link
Contributor Author

borjavb commented Jan 2, 2025

When are we planning to merge this to prod?

@vrishin-bolt We've moved this to an internal dbt more scoped PR with the new catalog definition... So I don't think this one will be merged. However, given how it has been rolled out for snowflake, the user interface of the parameters will be very similar to what is being pushed in this PR

@github-actions
Copy link
Contributor

github-actions bot commented Jul 2, 2025

This PR has been marked as Stale because it has been open with no activity as of late. If you would like the PR to remain open, please comment on the PR or else it will be closed in 7 days.

@github-actions github-actions bot added Stale and removed Stale labels Jul 2, 2025
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[Feature] Add support for iceberg table format in table and incremental materialization

2 participants