Skip to content

Commit eb3f3e2

Browse files
authored
Merge pull request #4208 from ClickHouse/fixes
fix data type in documentation and remove ssh tunnel for now
2 parents 1c37db6 + 2830d94 commit eb3f3e2

File tree

3 files changed

+11
-24
lines changed

3 files changed

+11
-24
lines changed
Lines changed: 10 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -1,10 +1,10 @@
11
---
2-
title: 'ClickPipes for MongoDB: Supported data types'
2+
title: 'Supported data types'
33
slug: /integrations/clickpipes/mongodb/datatypes
44
description: 'Page describing MongoDB ClickPipe datatype mapping from MongoDB to ClickHouse'
55
---
66

7-
MongoDB stores data records as BSON documents. In ClickPipes, you can configure to ingest BSON documents to ClickHouse as either JSON or JSON String. The following table shows the supported BSON to JSON type mapping:
7+
MongoDB stores data records as BSON documents. In ClickPipes, you can configure to ingest BSON documents to ClickHouse as either JSON or JSON String. The following table shows the supported BSON to JSON field type mapping:
88

99
| MongoDB BSON Type | ClickHouse JSON Type | Notes |
1010
| ------------------------ | -------------------------------------- | ------------------------ |
@@ -15,11 +15,15 @@ MongoDB stores data records as BSON documents. In ClickPipes, you can configure
1515
| Double | Float64 | |
1616
| Boolean | Bool | |
1717
| Date | String | ISO 8601 format |
18-
| Regular Expression | \{Options: String, Pattern: String\} | MongoDB regex with fixed fields: Options (regex flags) and Pattern (regex pattern) |
19-
| Timestamp | \{T: Int64, I: Int64\} | MongoDB internal timestamp format with fixed fields: T (timestamp) and I (increment) |
18+
| Regular Expression | \{Options: String, Pattern: String\} | MongoDB regex with fixed fields: Options (regex flags) and Pattern (regex pattern) |
19+
| Timestamp | \{T: Int64, I: Int64\} | MongoDB internal timestamp format with fixed fields: T (timestamp) and I (increment) |
2020
| Decimal128 | String | |
21-
| Array | Array(Nullable(String)) | |
22-
| Binary data | Array(Nullable(Int64)) | Array of byte values |
21+
| Binary data | \{Data: String, Subtype: Int64\} | MongoDB binary data with fixed fields: Data (base64-encoded) and Subtype ([type of binary](https://www.mongodb.com/docs/manual/reference/bson-types/#binary-data)) |
2322
| JavaScript | String | |
2423
| Null | Null | |
24+
| Array | Dynamic | Arrays with homogeneous types become Array(Nullable(T)); arrays with mixed primitive types are promoted to the most general common type; arrays with complex incompatible types become Tuples |
2525
| Object | Dynamic | Each nested field is mapped recursively |
26+
27+
:::info
28+
To learn more about ClickHouse's JSON data types, see [our documentation](https://clickhouse.com/docs/sql-reference/data-types/newjson).
29+
:::

docs/integrations/data-ingestion/clickpipes/mongodb/index.md

Lines changed: 0 additions & 17 deletions
Original file line numberDiff line numberDiff line change
@@ -10,7 +10,6 @@ import cp_service from '@site/static/images/integrations/data-ingestion/clickpip
1010
import cp_step0 from '@site/static/images/integrations/data-ingestion/clickpipes/cp_step0.png';
1111
import mongodb_tile from '@site/static/images/integrations/data-ingestion/clickpipes/mongodb/mongodb-tile.png'
1212
import mongodb_connection_details from '@site/static/images/integrations/data-ingestion/clickpipes/mongodb/mongodb-connection-details.png'
13-
import ssh_tunnel from '@site/static/images/integrations/data-ingestion/clickpipes/postgres/ssh-tunnel.jpg'
1413
import select_destination_db from '@site/static/images/integrations/data-ingestion/clickpipes/mongodb/select-destination-db.png'
1514
import ch_permissions from '@site/static/images/integrations/data-ingestion/clickpipes/postgres/ch-permissions.jpg'
1615
import Image from '@theme/IdealImage';
@@ -66,22 +65,6 @@ Make sure you are logged in to your ClickHouse Cloud account. If you don't have
6665

6766
<Image img={mongodb_connection_details} alt="Fill in connection details" size="lg" border/>
6867

69-
#### (Optional) Set up SSH Tunneling {#optional-set-up-ssh-tunneling}
70-
71-
You can specify SSH tunneling details if your source MongoDB database is not publicly accessible.
72-
73-
1. Enable the "Use SSH Tunnelling" toggle.
74-
2. Fill in the SSH connection details.
75-
76-
<Image img={ssh_tunnel} alt="SSH tunneling" size="lg" border/>
77-
78-
3. To use Key-based authentication, click on "Revoke and generate key pair" to generate a new key pair and copy the generated public key to your SSH server under `~/.ssh/authorized_keys`.
79-
4. Click on "Verify Connection" to verify the connection.
80-
81-
:::note
82-
Make sure to whitelist [ClickPipes IP addresses](../clickpipes#list-of-static-ips) in your firewall rules for the SSH bastion host so that ClickPipes can establish the SSH tunnel.
83-
:::
84-
8568
Once the connection details are filled in, click `Next`.
8669

8770
#### Configure advanced settings {#advanced-settings}

docs/integrations/data-ingestion/clickpipes/mysql/datatypes.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,5 +1,5 @@
11
---
2-
title: 'ClickPipes for MySQL: Supported data types'
2+
title: 'Supported data types'
33
slug: /integrations/clickpipes/mysql/datatypes
44
description: 'Page describing MySQL ClickPipe datatype mapping from MySQL to ClickHouse'
55
---

0 commit comments

Comments
 (0)