Skip to content

Commit fa87f86

Browse files
committed
Add View/Edit
1 parent 697d665 commit fa87f86

File tree

3 files changed

+89
-4
lines changed

3 files changed

+89
-4
lines changed

content/operate/rc/databases/rdi/_index.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -65,4 +65,4 @@ To create a new data pipeline, you need to:
6565
2. [Create data pipeline]({{<relref "/operate/rc/databases/rdi/create">}}) and troubleshoot errors.
6666
3. [Define the data pipeline]({{<relref "/operate/rc/databases/rdi/define">}}) by selecting which tables to sync.
6767

68-
Once your data pipeline is defined, you can [manage]() and [observe]() it.
68+
Once your data pipeline is defined, you can [view and edit]({{<relref "/operate/rc/databases/rdi/view-edit">}}) it.

content/operate/rc/databases/rdi/define.md

Lines changed: 9 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -18,14 +18,20 @@ After you have [created your data pipeline]({{<relref "/operate/rc/databases/rdi
1818
1. For the **Configure a new pipeline** option, select the Redis data type to write keys to the target. You can choose **Hash** or **JSON**.
1919

2020
Select **Continue**.
21-
1. Select the Schema and Tables you want to migrate to the target database from the **Source data selection** list.
21+
1. Select the Schema and Tables you want to migrate to the target database from the **Source data selection** list. You can select any number of columns from a table.
2222

2323
If any tables are missing a unique constraint, the **Missing unique constraint** list will appear. Select the columns that define a unique constraint for those tables from the list.
2424

25-
After you've selected the tables you want to sync, select **Continue**.
25+
Select **Add schema** to add additional database schemas.
26+
27+
Select **Delete** to delete a schema. You must have at least one schema to continue.
28+
29+
After you've selected the schemas and tables you want to sync, select **Continue**.
2630

2731
1. Review the tables you selected in the **Summary**. If everything looks correct, select **Start ingest** to start ingesting data from your source database.
2832

2933
At this point, the data pipeline will ingest data from the source database to your target Redis database. This process will take time, especially if you have a lot of records in your source database.
3034

31-
After this initial sync is complete, the data pipeline enters the *change streaming* phase, where changes are captured as they happen. Changes in the source database are added to the target within a few seconds of capture.
35+
After this initial sync is complete, the data pipeline enters the *change streaming* phase, where changes are captured as they happen. Changes in the source database are added to the target within a few seconds of capture.
36+
37+
You can view the status of your data pipeline in the **Data pipeline** tab of your database. See [View and edit data pipeline]({{<relref "/operate/rc/databases/rdi/view-edit">}}) to learn more.
Lines changed: 79 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,79 @@
1+
---
2+
Title: View and edit data pipeline
3+
alwaysopen: false
4+
categories:
5+
- docs
6+
- operate
7+
- rc
8+
description: Edit and observe your data pipeline.
9+
hideListLinks: true
10+
weight: 4
11+
---
12+
13+
You can use the **Data pipeline** tab in your database to view and edit it.
14+
15+
The **Data pipeline** tab gives an overview of your data pipeline and lets you view your data stream metrics.
16+
17+
## Edit data pipeline
18+
19+
To change the data you want to ingest from the data pipeline:
20+
21+
1. From the **Data pipeline** tab, select **Edit**.
22+
23+
1. For the **Configure a new pipeline** option, select the Redis data type to write keys to the target. You can choose **Hash** or **JSON**.
24+
25+
Select **Continue**.
26+
27+
1. Select the schema and tables you want to migrate to the target database from the **Source data selection** list. You can select any number of columns from a table.
28+
29+
If any tables are missing a unique constraint, the **Missing unique constraint** list will appear. Select the columns that define a unique constraint for those tables from the list.
30+
31+
Select **Add schema** to add additional database schema.
32+
33+
Select **Delete** to delete a schema. You must have at least one schema to continue.
34+
35+
After you've selected the schemas and tables you want to sync, select **Continue**.
36+
37+
1. Review the tables you selected in the **Summary** and select how you want to update the data pipeline:
38+
39+
- **Apply to new data changes only**: The data pipeline will only synchronize new updates to the schema and tables selected. The data pipeline will not ingest any data from new schemas or tables that are selected.
40+
- **Reset pipeline (re-process all data)**: The data pipeline will re-ingest all of the selected data.
41+
- **Flush cached data and reset pipeline**: The data pipeline will flush the target Redis database, and then re-ingest all of the selected data from the source database.
42+
43+
1. Select **Apply changes**.
44+
45+
At this point, the data pipeline will apply the changes. If you selected **Reset pipeline** or **Flush cached data and reset pipeline**, the data pipeline will ingest data from the source database to the target database. After this initial sync is complete, the data pipeline enters the *change streaming* phase, where changes are captured as they happen.
46+
47+
If you selected **Apply to new data changes only**, the data pipeline will enter the *change streaming* phase without ingesting the data.
48+
49+
## Reset data pipeline
50+
51+
To reset the data pipeline and restart the ingest process:
52+
53+
1. From the **Data pipeline** tab, select **More actions**, and then **Reset pipeline**.
54+
55+
1. If you want to flush the database, check **Flush target database**.
56+
57+
1. Select **Reset data pipeline**.
58+
59+
At this point, the data pipeline will re-ingest data from the source database to your target Redis database.
60+
61+
## Stop and restart data pipeline
62+
63+
To stop the data pipeline from synchronizing new data:
64+
65+
1. From the **Data pipeline** tab, select **More actions**, and then **Stop pipeline**.
66+
67+
1. Select **Stop data pipeline** to confirm.
68+
69+
Stopping the data pipeline will suspend data processing. To restart the pipeline from the **Data pipeline** tab, select **More actions**, and then **Start pipeline**.
70+
71+
## Delete pipeline
72+
73+
To delete the data pipeline:
74+
75+
1. From the **Data pipeline** tab, select **More actions**, and then **Delete pipeline**.
76+
77+
1. Select **Delete data pipeline** to confirm.
78+
79+
Deleted data pipelines cannot be recovered.

0 commit comments

Comments
 (0)