Skip to content

Conversation

@suremarc
Copy link
Collaborator

@suremarc suremarc commented Sep 17, 2025

This PR implements support for "dynamic" partition columns. These are partition columns that are generated at runtime during partition overwrite/insert/etc. (i.e. write operations). This allows users to partition a table in a finer-grained manner than was previously possible.

Prior to this change, materialized views, loosely speaking, could only be partitioned on expressions derived from partition columns of other tables. This restriction is now only placed on the "static" partition columns, which must be a prefix of the full list of partition columns.

@suremarc suremarc marked this pull request as ready for review September 17, 2025 05:17
@suremarc suremarc merged commit 5915f4c into main Sep 25, 2025
8 checks passed
@suremarc suremarc deleted the static-partition-columns branch September 25, 2025 04:18
@github-actions github-actions bot mentioned this pull request Sep 25, 2025
suremarc added a commit that referenced this pull request Sep 25, 2025
* Support static partition columns for MV

* runtime checks

* unit test for dynamic partition columns

* lint
suremarc added a commit to massive-com/datafusion-materialized-views that referenced this pull request Sep 25, 2025
suremarc added a commit to massive-com/datafusion-materialized-views that referenced this pull request Oct 1, 2025
* Support static partition columns for MV

* runtime checks

* unit test for dynamic partition columns

* lint
@github-actions github-actions bot mentioned this pull request Oct 24, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants