BigQuery Connector - Ability to choose the "Partitioned on field" #62440
timorkal
started this conversation in
Connector Ideas and Features
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Right now the default "Partitioned on field" is _airbyte_extracted_at, which might be good for some use cases.
But in my usecase it's not giving me the performance that I need as I have my own column which is "created_at" where most of the queries are using, and I would like to Partition my table based on this.
The _airbyte_extracted_at is also relevant only for the day of the "extraction" which is not ideal, but the "created_at" is relevant to the real date when the data was added to my source table originally.
Beta Was this translation helpful? Give feedback.
All reactions