Schema change detection #296
Replies: 3 comments
-
Is this related to full-refresh mode where an existing schema is present and a new one (e.g. an additional column added) is being materialized? @flarco the default behavior seems to fail in this case, which i didn't expect. I thought the table would be wiped and any new columns would be added to new table, but that didn't seem to be happening. Is this expected? |
Beta Was this translation helpful? Give feedback.
-
hey Brice, if it is full refresh, it should recreate the table with the new column. If incremental, it should add the new column (and not fail). Can you paste your log output with debug mode here? |
Beta Was this translation helpful? Give feedback.
-
my apologies - looking closer, this is a dagster issue using SnowflakePandasIOManager... |
Beta Was this translation helpful? Give feedback.
Uh oh!
There was an error while loading. Please reload this page.
-
Feature Description
Schema change detection. Of course, it'll fail so the question is many continuous testing?
Beta Was this translation helpful? Give feedback.
All reactions