You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
A schema registry can be configured by when setting up a ClickPipe. This can be configured in one of three ways:
95
+
ClickPipes with Avro data require a schema registry. This can be configured in one of three ways:
96
96
97
-
1. Providing the root schema registry URL (e.g. `https://registry.example.com`). **This is the preferred method.**
97
+
1. Providing a complete path to the schema subject (e.g. `https://registry.example.com/subjects/events`)
98
+
- Optionally, a specific version can be referenced by appending `/versions/[version]` to the url (otherwise ClickPipes will retrieve the latest version).
98
99
2. Providing a complete path to the schema id (e.g. `https://registry.example.com/schemas/ids/1000`)
99
-
3. Providing a complete path to the schema subject (e.g. `https://registry.example.com/subjects/events`)
100
-
- Optionally, a specific version can be referenced by appending `/versions/[version]` to the url (otherwise ClickPipes will retrieve the latest version).
100
+
3. Providing the root schema registry URL (e.g. `https://registry.example.com`)
101
101
102
102
### How it works {#how-schema-registries-work}
103
103
ClickPipes dynamically retrieves and applies the Avro schema from the configured Schema Registry.
@@ -190,8 +190,6 @@ Nullable types in Avro are defined by using a Union schema of `(T, null)` or `(n
190
190
- An empty Map for a null Avro Map
191
191
- A named Tuple with all default/zero values for a null Avro Record
192
192
193
-
ClickPipes does not currently support schemas that contain other Avro Unions (this may change in the future with the maturity of the new ClickHouse Variant and JSON data types). If the Avro schema contains a "non-null" union, ClickPipes will generate an error when attempting to calculate a mapping between the Avro schema and Clickhouse column types.
194
-
195
193
## Kafka virtual columns {#kafka-virtual-columns}
196
194
197
195
The following virtual columns are supported for Kafka compatible streaming data sources. When creating a new destination table virtual columns can be added by using the `Add Column` button.
0 commit comments