You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: tidb-cloud/migrate-from-mysql-using-data-migration.md
+31-12Lines changed: 31 additions & 12 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -25,7 +25,9 @@ If you only want to replicate ongoing binlog changes from your MySQL-compatible
25
25
### Availability
26
26
27
27
- Currently, the Data Migration features is not available for {{{ .starter }}}.
28
-
- If you don't see the [Data Migration](/tidb-cloud/migrate-from-mysql-using-data-migration.md#step-1-go-to-the-data-migration-page) entry for your <CustomContentplan="dedicated">{{{ .dedicated }}}</CustomContent><CustomContentplan="essential">{{{ .essential }}}</CustomContent> cluster in the [TiDB Cloud console](https://tidbcloud.com/), the feature might not be available in your region. To request support for your region, contact [TiDB Cloud Support](/tidb-cloud/tidb-cloud-support.md).
28
+
<CustomContentplan="dedicated">
29
+
- If you don't see the [Data Migration](/tidb-cloud/migrate-from-mysql-using-data-migration.md#step-1-go-to-the-data-migration-page) entry for your {{{ .dedicated }}}cluster in the [TiDB Cloud console](https://tidbcloud.com/), the feature might not be available in your region. To request support for your region, contact [TiDB Cloud Support](/tidb-cloud/tidb-cloud-support.md).
30
+
</CustomContent>
29
31
- Amazon Aurora MySQL writer instances support both existing data and incremental data migration. Amazon Aurora MySQL reader instances only support existing data migration and do not support incremental data migration.
30
32
31
33
### Maximum number of migration jobs
@@ -45,8 +47,12 @@ You can create up to 100 migration jobs on {{{ .essential }}} clusters for each
45
47
46
48
- The system databases will be filtered out and not migrated to TiDB Cloud even if you select all of the databases to migrate. That is, `mysql`, `information_schema`, `performance_schema`, and `sys` will not be migrated using this feature.
47
49
50
+
<CustomContentplan="dedicated">
51
+
48
52
- When you delete a cluster in TiDB Cloud, all migration jobs in that cluster are automatically deleted and not recoverable.
49
53
54
+
</CustomContent>
55
+
50
56
<CustomContentplan="essential">
51
57
52
58
### Limitations of Alibaba Cloud RDS
@@ -82,11 +88,15 @@ To prevent this, create the target tables in the downstream database before star
82
88
83
89
- During incremental replication (migrating ongoing changes to your cluster), if the migration job recovers from an abrupt error, it might open the safe mode for 60 seconds. During the safe mode, `INSERT` statements are migrated as `REPLACE`, `UPDATE` statements as `DELETE` and `REPLACE`, and then these transactions are migrated to the target TiDB Cloud cluster to ensure that all the data during the abrupt error has been migrated smoothly to the target TiDB Cloud cluster. In this scenario, for MySQL source tables without primary keys or non-null unique indexes, some data might be duplicated in the target TiDB Cloud cluster because the data might be inserted repeatedly into the target TiDB Cloud cluster.
84
90
91
+
<CustomContentplan="dedicated">
92
+
85
93
- In the following scenarios, if the migration job takes longer than 24 hours, do not purge binary logs in the source database. This allows Data Migration to get consecutive binary logs for incremental replication:
86
94
87
95
- During the existing data migration.
88
96
- After the existing data migration is completed and when incremental data migration is started for the first time, the latency is not 0 ms.
89
97
98
+
</CustomContent>
99
+
90
100
## Prerequisites
91
101
92
102
Before migrating, check whether your data source is supported, enable binary logging in your MySQL-compatible database, ensure network connectivity, and grant required privileges for both the source database and the target TiDB Cloud cluster database.
@@ -209,8 +219,6 @@ For detailed instructions, see [Configure database flags](https://cloud.google.c
@@ -234,8 +242,6 @@ For detailed instructions, see [Set instance parameters](https://www.alibabaclou
234
242
235
243
</details>
236
244
237
-
</CustomContent>
238
-
239
245
### Ensure network connectivity
240
246
241
247
Before creating a migration job, you need to plan and set up proper network connectivity between your source MySQL instance, the TiDB Cloud Data Migration (DM) service, and your target TiDB Cloud cluster.
@@ -274,10 +280,7 @@ Regardless of the connection method, it is strongly recommended to use TLS/SSL f
274
280
- Amazon Aurora MySQL or Amazon RDS MySQL: [Using SSL/TLS to encrypt a connection to a DB instance or cluster](https://docs.aws.amazon.com/AmazonRDS/latest/AuroraUserGuide/UsingWithRDS.SSL.html)
275
281
- Azure Database for MySQL - Flexible Server: [Connect with encrypted connections](https://learn.microsoft.com/en-us/azure/mysql/flexible-server/how-to-connect-tls-ssl)
276
282
- Google Cloud SQL for MySQL: [Manage SSL/TLS certificates](https://cloud.google.com/sql/docs/mysql/manage-ssl-instance)
277
-
278
-
<CustomContent plan="essential">
279
283
- Alibaba Cloud RDS MySQL: [Configure the SSL encryption feature](https://www.alibabacloud.com/help/en/rds/apsaradb-rds-for-mysql/configure-a-cloud-certificate-to-enable-ssl-encryption)
280
-
</CustomContent>
281
284
282
285
</details>
283
286
@@ -494,7 +497,7 @@ On the **Create Migration Job** page, configure the source and target connection
494
497
</CustomContent>
495
498
<CustomContentplan="essential">
496
499
497
-
-**Public IP**: available for all cloud providers (recommended for testing and proof-of-concept migrations).
500
+
-**Public**: available for all cloud providers (recommended for testing and proof-of-concept migrations).
498
501
-**Private Link**: available for AWS and Alibaba Cloud only (recommended for production workloads requiring private connectivity).
499
502
500
503
</CustomContent>
@@ -639,7 +642,7 @@ For detailed instructions about incremental data migration, see [Migrate Only In
639
642
640
643
- If you click **All**, the migration job will migrate the existing data from the whole source database instance to TiDB Cloud and migrate ongoing changes after the full migration. Note that it happens only if you have selected the **Existing data migration** and **Incremental data migration** checkboxes in the previous step.
641
644
- If you click **Customize** and select some databases, the migration job will migrate the existing data and migrate ongoing changes of the selected databases to TiDB Cloud. Note that it happens only if you have selected the **Existing data migration** and **Incremental data migration** checkboxes in the previous step.
642
-
- If you click **Customize** and select some tables under a dataset name, the migration job will only migrate the existing data and migrate ongoing changes of the selected tables. Tables created afterwards in the same database will not be migrated.
645
+
- If you click **Customize** and select some tables under a database name, the migration job will only migrate the existing data and migrate ongoing changes of the selected tables. Tables created afterwards in the same database will not be migrated.
643
646
644
647
2. Click **Next**.
645
648
@@ -655,6 +658,24 @@ For more information about precheck items, see [Migration Task Precheck](https:/
655
658
656
659
If all check items show **Pass**, click **Next**.
657
660
661
+
<CustomContentplan="essential">
662
+
663
+
## Step 6: View the migration progress
664
+
665
+
After the migration job is created, you can view the migration progress on the **Migration Job Details** page. The migration progress is displayed in the **Stage and Status** area.
666
+
667
+
You can pause or delete a migration job when it is running.
668
+
669
+
If a migration job has failed, you can resume it after solving the problem.
670
+
671
+
You can delete a migration job in any status.
672
+
673
+
If you encounter any problems during the migration, see [Migration errors and solutions](/tidb-cloud/tidb-cloud-dm-precheck-and-troubleshooting.md#migration-errors-and-solutions).
674
+
675
+
</CustomContent>
676
+
677
+
<CustomContentplan="dedicated">
678
+
658
679
## Step 6: Choose a spec and start migration
659
680
660
681
On the **Choose a Spec and Start Migration** page, select an appropriate migration specification according to your performance requirements. For more information about the specifications, see [Specifications for Data Migration](/tidb-cloud/tidb-cloud-billing-dm.md#specifications-for-data-migration).
@@ -673,8 +694,6 @@ You can delete a migration job in any status.
673
694
674
695
If you encounter any problems during the migration, see [Migration errors and solutions](/tidb-cloud/tidb-cloud-dm-precheck-and-troubleshooting.md#migration-errors-and-solutions).
675
696
676
-
<CustomContentplan="dedicated">
677
-
678
697
## Scale a migration job specification
679
698
680
699
TiDB Cloud Dedicated supports scaling up or down a migration job specification to meet your performance and cost requirements in different scenarios.
Copy file name to clipboardExpand all lines: tidb-cloud/migrate-incremental-data-from-mysql-using-data-migration.md
+18-3Lines changed: 18 additions & 3 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -72,8 +72,6 @@ If the result is `ON` or `ON_PERMISSIVE`, the GTID mode is successfully enabled.
72
72
73
73
For more information, see [Parameters for GTID-based replication](https://docs.aws.amazon.com/AmazonRDS/latest/UserGuide/mysql-replication-gtid.html#mysql-replication-gtid.parameters).
74
74
75
-
<CustomContent plan="dedicated">
76
-
77
75
### For Google Cloud SQL for MySQL
78
76
79
77
The GTID mode is enabled for Google Cloud SQL for MySQL by default. You can check if the GTID mode has been successfully enabled by executing the following SQL statement:
@@ -96,7 +94,6 @@ SHOW VARIABLES LIKE 'binlog_row_image';
96
94
97
95
If the result is not `FULL`, you need to configure this parameter for your Azure Database for MySQL instance using the [Azure portal](https://portal.azure.com/) or [Azure CLI](https://learn.microsoft.com/en-us/cli/azure/).
98
96
99
-
</CustomContent>
100
97
101
98
### For Alibaba Cloud RDS MySQL
102
99
@@ -273,6 +270,24 @@ For more information about precheck items, see [Migration Task Precheck](https:/
273
270
274
271
If all check items show **Pass**, click **Next**.
275
272
273
+
<CustomContent plan="essential">
274
+
275
+
## Step 6: View the migration progress
276
+
277
+
After the migration job is created, you can view the migration progress on the **Migration Job Details** page. The migration progress is displayed in the **Stage and Status** area.
278
+
279
+
You can pause ordelete a migration job when it is running.
280
+
281
+
If a migration job has failed, you can resume it after solving the problem.
282
+
283
+
You can delete a migration job in any status.
284
+
285
+
If you encounter any problems during the migration, see [Migration errors and solutions](/tidb-cloud/tidb-cloud-dm-precheck-and-troubleshooting.md#migration-errors-and-solutions).
286
+
287
+
</CustomContent>
288
+
289
+
<CustomContent plan="dedicated">
290
+
276
291
## Step 6: Choose a spec and start migration
277
292
278
293
On the **Choose a Spec and Start Migration** page, select an appropriate migration specification according to your performance requirements. For more information about the specifications, see [Specifications for Data Migration](/tidb-cloud/tidb-cloud-billing-dm.md#specifications-for-data-migration).
0 commit comments