Skip to content

Commit 8ac8934

Browse files
authored
Update parallel_initial_load.md
1 parent bd6859b commit 8ac8934

File tree

1 file changed

+3
-2
lines changed

1 file changed

+3
-2
lines changed

docs/integrations/data-ingestion/clickpipes/mysql/parallel_initial_load.md

Lines changed: 3 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -7,6 +7,7 @@ sidebar_label: 'How parallel snapshot works'
77

88
import snapshot_params from '@site/static/images/integrations/data-ingestion/clickpipes/mysql/snapshot_params.png'
99
import partition_key from '@site/static/images/integrations/data-ingestion/clickpipes/mysql/partition_key.png'
10+
import Image from '@theme/IdealImage';
1011

1112
This document explains parallelized snapshot/initial load in the MySQL ClickPipe works and talks about the snapshot parameters that can be used to control it.
1213

@@ -18,7 +19,7 @@ However, the MySQL ClickPipe can parallelize this process, which can significant
1819
### Partition key column {#key-mysql-snapshot}
1920

2021
Once we've enabled the feature flag, you should see the below setting in the ClickPipe table picker (both during creation and editing of a ClickPipe):
21-
<img src={partition_key} alt="Partition key column" />
22+
<Image src={partition_key} alt="Partition key column" size="md"/>
2223

2324
The MySQL ClickPipe uses a column on your source table to logically partition the source tables. This column is called the **partition key column**. It is used to divide the source table into partitions, which can then be processed in parallel by the ClickPipe.
2425

@@ -30,7 +31,7 @@ The partition key column must be indexed in the source table to see a good perfo
3031

3132
Let's talk about the below settings:
3233

33-
<img src={snapshot_params} alt="Snapshot parameters" />
34+
<Image src={snapshot_params} alt="Snapshot parameters" size="md"/>
3435

3536
#### Snapshot number of rows per partition {#numrows-mysql-snapshot}
3637
This setting controls how many rows constitute a partition. The ClickPipe will read the source table in chunks of this size, and chunks will be processed in parallel based on the initial load parallelism set. The default value is 100,000 rows per partition.

0 commit comments

Comments
 (0)