Commit e41d8ef
committed
Never use
There are edge case tables/schemas in which the loader previously tried
to alter the table to add a required nested column to a pre-existing
struct column. We saw this error message:
```
message": "Provided Schema does not match Table <redacted>:<redacted>.events. Cannot add required fields to an existing schema. (field: <redacted>.<redacted>)
```
This scenario happens only if a schema has been patched after the loader
already created the column; or if the table is manually altered; or
other similar mis-uses of schemas.
This commit works around the issue by forcing nested columns to be
NULLABLE if the parent struct column already exists.REQUIRED mode for new nested fields of existing columns1 parent 7b011b1 commit e41d8ef
File tree
1 file changed
+1
-1
lines changed- modules/core/src/main/scala/com.snowplowanalytics.snowplow.bigquery/processing
1 file changed
+1
-1
lines changedLines changed: 1 addition & 1 deletion
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
81 | 81 | | |
82 | 82 | | |
83 | 83 | | |
84 | | - | |
| 84 | + | |
85 | 85 | | |
86 | 86 | | |
87 | 87 | | |
| |||
0 commit comments