You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: content/operate/rc/databases/rdi/define.md
+20-8Lines changed: 20 additions & 8 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -32,7 +32,9 @@ After you have [prepared your source database]({{<relref "/operate/rc/databases/
32
32
-**PDB**: Name of the Oracle pluggable database *(Oracle only)*
33
33
1. Enter the ARN of your [database credentials secret]({{< relref "/operate/rc/databases/rdi/setup#create-database-credentials-secrets" >}}) in the **Source database secrets ARN** field.
34
34
1. If your database requires TLS, select **Use TLS**. Enter the ARN of your [CA certificate secret]({{< relref "/operate/rc/databases/rdi/setup#create-database-credentials-secrets" >}}) in the **CA Cert Secret ARN** field.
35
+
{{<imagefilename="images/rc/rdi/rdi-define-tls.png"alt="The Source database connectivity section, with Use TLS selected and the CA Cert Secret ARN field." >}}
35
36
1. If your database requires mTLS, select **Use mTLS**. Enter the ARN of your [Client certificate secret]({{< relref "/operate/rc/databases/rdi/setup#create-database-credentials-secrets" >}}) in the **Client Certificate Secret ARN** field and the ARN of your [Client key secret]({{< relref "/operate/rc/databases/rdi/setup#create-database-credentials-secrets" >}}) in the **Client Key Secret ARN** field.
37
+
{{<imagefilename="images/rc/rdi/rdi-define-mtls.png"alt="The Source database connectivity section, with Use TLS selected and the Client Certificate Secret ARN and Client Key Secret ARN fields." >}}
36
38
1. If your database requires mTLS with a client key passphrase, enter the ARN of your [Client key passphrase secret]({{< relref "/operate/rc/databases/rdi/setup#create-database-credentials-secrets" >}}) in the **Please add a secret ARN for the password to use with the secret store** field.
@@ -56,21 +58,29 @@ After your pipeline is provisioned, you will be able to define your pipeline. Yo
56
58
57
59
### Configure a new pipeline
58
60
59
-
1. In the [Redis Cloud console](https://cloud.redis.io/), go to your target database and select the **Data Pipeline** tab. If your pipeline is already provisioned, select **Complete setup** to go to the **Select data** section.
61
+
1. In the [Redis Cloud console](https://cloud.redis.io/), go to your target database and select the **Data Pipeline** tab. If your pipeline is already provisioned, select **Complete setup** to go to the **Data modeling** section.
You can select any number of columns from a table.
65
71
66
-
{{<imagefilename="images/rc/rdi/rdi-select-columns.png"alt="The select source data section. A table is expanded with a few columns selected."width=75% >}}
72
+
{{<imagefilename="images/rc/rdi/rdi-select-columns.png"alt="The manage columns screen, with a few columns selected from one table"width=75% >}}
67
73
68
-
If any tables are missing a unique constraint, the **Missing unique constraint**list will appear. Select the columns that define a unique constraint for those tables from the list.
74
+
If any tables are missing a unique constraint, a warning will appear in the **Data modeling**section. Select **Manage columns** to select the columns that define a unique constraint for those tables.
1.In the **Pipeline definition** section, select the Redis data type to write keys to the target. You can choose **Hash** or **JSON** if the target database supports JSON.
96
+
1.Select the Redis data type to write keys to the target. You can choose **Hash** or **JSON** if the target database supports JSON.
You can also supply one or more [transformation job files]({{< relref "/integrate/redis-data-integration/data-pipelines/transform-examples" >}}) that specify how you want to transform the captured data before writing it to the target. Select **Upload jobs** to upload your job files.
90
100
91
101
{{<imagefilename="images/rc/rdi/rdi-transformation-jobs.png"alt="The transformation jobs section. Select Upload jobs to upload transformation jobs." >}}
92
102
103
+
When you upload job files, Redis Cloud will validate the job files to check for errors.
1. Review the tables you selected in the **Summary**. If everything looks correct, select **Start ingest** to start ingesting data from your source database.
108
+
1. Review the tables you selected in the **Review and deploy** section. If everything looks correct, select **Confirm & Deploy** to start ingesting data from your source database.
At this point, the data pipeline will ingest data from the source database to your target Redis database. This process will take time, especially if you have a lot of records in your source database.
You can select any number of columns from a table.
57
60
58
-
{{<imagefilename="images/rc/rdi/rdi-select-columns.png"alt="The select source data section. A table is expanded with a few columns selected."width=75% >}}
61
+
{{<imagefilename="images/rc/rdi/rdi-select-columns.png"alt="The manage columns screen, with a few columns selected from one table"width=75% >}}
59
62
60
-
If any tables are missing a unique constraint, the **Missing unique constraint**list will appear. Select the columns that define a unique constraint for those tables from the list.
63
+
If any tables are missing a unique constraint, a warning will appear in the **Data modeling**section. Select **Manage columns** to select the columns that define a unique constraint for those tables.
1. In the **Pipeline definition** section, select the Redis data type to write keys to the target. You can choose **Hash** or **JSON** if the target database supports JSON.
88
+
You can also supply one or more [transformation job files]({{< relref "/integrate/redis-data-integration/data-pipelines/transform-examples" >}}) that specify how you want to transform the captured data before writing it to the target. Select **Upload jobs** to upload your job files.
89
+
90
+
{{<imagefilename="images/rc/rdi/rdi-transformation-jobs.png"alt="The transformation jobs section. Select Upload jobs to upload transformation jobs." >}}
91
+
92
+
When you upload job files, Redis Cloud will validate the job files to check for errors.
79
93
80
-
{{<imagefilename="images/rc/rdi/rdi-configure-new-pipeline.png"alt="The Pipeline definition screen. Configure a new pipeline is selected."width=75% >}}
0 commit comments