|
| 1 | +--- |
| 2 | +sidebar_label: 'Kafka Connector Sink on Confluent Cloud' |
| 3 | +sidebar_position: 2 |
| 4 | +slug: /integrations/kafka/cloud/confluent/custom-connector |
| 5 | +description: 'Using Fully Managed ClickHouse Connector Sink on Confluent Cloud' |
| 6 | +title: 'Integrating Confluent Cloud with ClickHouse' |
| 7 | +--- |
| 8 | + |
| 9 | +import ConnectionDetails from '@site/docs/_snippets/_gather_your_details_http.mdx'; |
| 10 | +import Image from '@theme/IdealImage'; |
| 11 | + |
| 12 | +# Integrating Confluent Cloud with ClickHouse |
| 13 | + |
| 14 | +<div class='vimeo-container'> |
| 15 | + <iframe src="//www.youtube.com/embed/SQAiPVbd3gg" |
| 16 | + width="640" |
| 17 | + height="360" |
| 18 | + frameborder="0" |
| 19 | + allow="autoplay; |
| 20 | + fullscreen; |
| 21 | + picture-in-picture" |
| 22 | + allowfullscreen> |
| 23 | + </iframe> |
| 24 | +</div> |
| 25 | + |
| 26 | +## Prerequisites {#prerequisites} |
| 27 | +We assume you are familiar with: |
| 28 | +* [ClickHouse Connector Sink](../kafka-clickhouse-connect-sink.md) |
| 29 | +* Confluent Cloud |
| 30 | + |
| 31 | +## The official Kafka connector from ClickHouse with Confluent Cloud {#the-official-kafka-connector-from-clickhouse-with-confluent-cloud} |
| 32 | + |
| 33 | +### Installing on Confluent Cloud {#installing-on-confluent-cloud} |
| 34 | +This is meant to be a quick guide to get you started with the ClickHouse Sink Connector on Confluent Cloud. |
| 35 | +For more details, please refer to the [official Confluent documentation](https://docs.confluent.io/cloud/current/connectors/bring-your-connector/custom-connector-qs.html#uploading-and-launching-the-connector). |
| 36 | + |
| 37 | +#### Create a Topic {#create-a-topic} |
| 38 | +Creating a topic on Confluent Cloud is fairly simple, and there are detailed instructions [here](https://docs.confluent.io/cloud/current/client-apps/topics/manage.html). |
| 39 | + |
| 40 | +#### Important Notes {#important-notes} |
| 41 | + |
| 42 | +* The Kafka topic name must be the same as the ClickHouse table name. The way to tweak this is by using a transformer (for example [`ExtractTopic`](https://docs.confluent.io/platform/current/connect/transforms/extracttopic.html)). |
| 43 | +* More partitions does not always mean more performance - see our upcoming guide for more details and performance tips. |
| 44 | + |
| 45 | +#### Gather your connection details {#gather-your-connection-details} |
| 46 | +<ConnectionDetails /> |
| 47 | + |
| 48 | + |
| 49 | +#### Install Connector {#install-connector} |
| 50 | +Install the Fully Managed ClickHouse Sink Connector on Confluent Cloud following the [official documentation](https://docs.confluent.io/cloud/current/connectors/cc-clickhouse-sink-connector/cc-clickhouse-sink.html). |
| 51 | + |
| 52 | + |
| 53 | +#### Configure the Connector {#configure-the-connector} |
| 54 | +During the configuration of the ClickHouse Sink Connector, you will need to provide the following details: |
| 55 | +- hostname of your ClickHouse server |
| 56 | +- port of your ClickHouse server (default is 8443) |
| 57 | +- username and password for your ClickHouse server |
| 58 | +- database name in ClickHouse where the data will be written |
| 59 | +- topic name in Kafka that will be used to write data to ClickHouse |
| 60 | + |
| 61 | +The Confluent Cloud UI supports advanced configuration options to adjust poll intervals, batch sizes, and other parameters to optimize performance. |
| 62 | + |
| 63 | +#### Known Limitations {#known-limitations} |
| 64 | +* See the list of [Connectors limitations in the official docs](https://docs.confluent.io/cloud/current/connectors/cc-clickhouse-sink-connector/cc-clickhouse-sink.html#limitations) |
0 commit comments