You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: content/operate/rc/databases/rdi/_index.md
+4-3Lines changed: 4 additions & 3 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -47,22 +47,23 @@ Before you can create a data pipeline, you must have:
47
47
- Oracle
48
48
- SQL Server
49
49
- PostgreSQL
50
+
- mariaDB
51
+
- Aurora
50
52
51
53
{{< note >}}
52
54
Please be aware of the following limitations:
53
55
54
56
- The target database must be a Redis Cloud Pro database hosted on Amazon Web Services (AWS). Redis Cloud Essentials databases and databases hosted on Google Cloud do not support Data Integration.
55
-
- Only the Ingest use case is supported at this time.
56
57
- Source databases must also be hosted on AWS.
57
-
- One source database can only be connected to one target database.
58
+
- One source database can only be synced to one target database.
58
59
{{< /note >}}
59
60
60
61
## Get started
61
62
62
63
To create a new data pipeline, you need to:
63
64
64
65
1.[Prepare your source database]({{<relref "/operate/rc/databases/rdi/setup">}}) and any associated credentials.
65
-
2.[Create data pipeline]({{<relref "/operate/rc/databases/rdi/create">}}) and troubleshoot errors.
66
+
2.[Provision data pipeline infrastructure]({{<relref "/operate/rc/databases/rdi/provision">}}) and troubleshoot errors.
66
67
3.[Define the data pipeline]({{<relref "/operate/rc/databases/rdi/define">}}) by selecting which tables to sync.
67
68
68
69
Once your data pipeline is defined, you can [view and edit]({{<relref "/operate/rc/databases/rdi/view-edit">}}) it.
Copy file name to clipboardExpand all lines: content/operate/rc/databases/rdi/define.md
+2-2Lines changed: 2 additions & 2 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -10,11 +10,11 @@ hideListLinks: true
10
10
weight: 3
11
11
---
12
12
13
-
After you have [created your data pipeline]({{<relref "/operate/rc/databases/rdi/create">}}), you need to define it. You will select the database schemas and columns that you want to import and synchronize with your primary database.
13
+
After you have [provisioned your data pipeline]({{<relref "/operate/rc/databases/rdi/provision]">}}), you need to define it. You will select the database schemas and columns that you want to import and synchronize with your primary database.
14
14
15
15
## Configure a new pipeline
16
16
17
-
1. In the [Redis Cloud console](https://cloud.redis.io/), go to your target database and select the **Data Pipeline** tab. If your pipeline is already created, select **Complete setup** to go to the **Pipeline definition** section.
17
+
1. In the [Redis Cloud console](https://cloud.redis.io/), go to your target database and select the **Data Pipeline** tab. If your pipeline is already provisioned, select **Complete setup** to go to the **Pipeline definition** section.
18
18
1. For the **Configure a new pipeline** option, select the Redis data type to write keys to the target. You can choose **Hash** or **JSON**.
description: Create and troubleshoot your data pipeline.
8
+
description: Provision and troubleshoot your data pipeline infrastructure.
9
9
hideListLinks: true
10
10
weight: 2
11
11
---
@@ -19,20 +19,20 @@ After you have [prepared your source database]({{<relref "/operate/rc/databases/
19
19
1. In the **Connectivity** section, enter the **PrivateLink service name** of the [PrivateLink connected to your source database]({{< relref "/operate/rc/databases/rdi/setup#set-up-connectivity" >}}).
20
20
1. Enter your database details. This depends on your database type, and includes:
21
21
-**Port**: The database's port
22
-
-**Database**: Your database's name, or the root database
22
+
-**Database**: Your database's name, or the root database*(PostgresSQL, Oracle only)*; or a comma-separated list of one or more databases you want to connect to *(SQL Server only)*
23
23
-**Database Server ID**: Unique ID for the replication client. Leave as default if you don't use replication *(mySQL and mariaDB only)*
24
24
-**PDB**: Name of the Oracle pluggable database *(Oracle only)*
25
25
1. Enter the ARN of your [database credentials secret]({{< relref "/operate/rc/databases/rdi/setup#share-source-database-credentials" >}}) in the **Source database secrets ARN** field.
26
26
1. Select **Start pipeline setup**.
27
27
28
-
At this point, Redis Cloud will attempt to create your new pipeline.
28
+
At this point, Redis Cloud will provision the pipeline infrastructure that will allow you to define your data pipeline.
29
29
30
-
Pipelines are created in the background. While they're being created, you aren't allowed to make changes. This process will take some time.
30
+
Pipelines are provisioned in the background. You aren't allowed to make changes to your data pipeline or to your database during provisioning. This process will take a long time, so you can close the window and come back later.
31
31
32
32
See [Pipeline creation errors](#pipeline-creation-errors) to view a list of errors that can occur at this point.
33
33
34
-
When your pipeline is created, select **Complete setup**. You will then [define your data pipeline]({{<relref "/operate/rc/databases/rdi/define">}}).
34
+
When your pipeline is provisioned, select **Complete setup**. You will then [define your data pipeline]({{<relref "/operate/rc/databases/rdi/define">}}).
Copy file name to clipboardExpand all lines: content/operate/rc/databases/rdi/setup.md
+2-2Lines changed: 2 additions & 2 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -31,7 +31,7 @@ See the [RDI architecture overview]({{< relref "/integrate/redis-data-integratio
31
31
32
32
## Share source database credentials
33
33
34
-
You need to share your source database credentials in an Amazon secret with Redis Cloud so that the pipeline can connect to your database.
34
+
You need to share your source database credentials and certificates in an Amazon secret with Redis Cloud so that the pipeline can connect to your database.
35
35
36
36
In the [AWS Management Console](https://console.aws.amazon.com/), use the **Services** menu to locate and select **Security, Identity, and Compliance** > **Secrets Manager**. [Create a secret](https://docs.aws.amazon.com/secretsmanager/latest/userguide/create_secret.html) of type **Other type of secret** with the following key/value fields:
37
37
@@ -63,4 +63,4 @@ For more details on AWS PrivateLink, see [Share your services through AWS Privat
63
63
64
64
## Next steps
65
65
66
-
After you have set up your source database and prepared connectivity and credentials, select **Start pipeline setup** to [create your data pipeline]({{<relref "/operate/rc/databases/rdi/create">}}).
66
+
After you have set up your source database and prepared connectivity and credentials, select **Start pipeline setup** to [provision data pipeline infrastructure]({{<relref "/operate/rc/databases/rdi/provision">}}).
0 commit comments