You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: docs/integrations/data-ingestion/clickpipes/kafka.md
+6Lines changed: 6 additions & 0 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -208,6 +208,12 @@ The following virtual columns are supported for Kafka compatible streaming data
208
208
Note that the _raw_message column is only recommended for JSON data. For use cases where only the JSON string is required (such as using ClickHouse [`JsonExtract*`](/sql-reference/functions/json-functions#jsonextract-functions) functions to populate a downstream materialized
209
209
view), it may improve ClickPipes performance to delete all the "non-virtual" columns.
210
210
211
+
## Best Practices {#best-practices}
212
+
213
+
### Message Compression {#compression}
214
+
We strongly recommend using compression for your Kafka topics. Compression can result in a significant saving in data transfer costs with virtually no performance hit.
215
+
To learn more about message compression in Kafka, we recommend starting with this [guide](https://www.confluent.io/blog/apache-kafka-message-compression/).
216
+
211
217
## Limitations {#limitations}
212
218
213
219
-[DEFAULT](/sql-reference/statements/create/table#default) is not supported.
0 commit comments