dbt-athena partitioned_by property #1113
Unanswered
ShaunHide17
asked this question in
Q&A
Replies: 1 comment
-
The 100 partition limit is a hard limit imposed by the AWS Glue Catalog. If you use Iceberg tables, dbt-athena can automatically paginate partition insertions to work around this limitation. |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
As part of the table properties, you can specify a list of columns by which the output table can be partitioned by.
The documentation reads as below:
Is this partition cap still in force, and if so, why 100?
Beta Was this translation helpful? Give feedback.
All reactions