|
| 1 | +--- |
| 2 | +Title: Prepare AWS Aurora and PostgreSQL for RDI |
| 3 | +aliases: /integrate/redis-data-integration/ingest/data-pipelines/prepare-dbs/my-sql-mariadb/ |
| 4 | +alwaysopen: false |
| 5 | +categories: |
| 6 | +- docs |
| 7 | +- integrate |
| 8 | +- rs |
| 9 | +- rdi |
| 10 | +description: Prepare AWS Aurora/PostgreSQL databases to work with RDI |
| 11 | +group: di |
| 12 | +linkTitle: Prepare AWS Aurora/PostgreSQL |
| 13 | +summary: Redis Data Integration keeps Redis in sync with the primary database in near |
| 14 | + real time. |
| 15 | +type: integration |
| 16 | +weight: 5 |
| 17 | +--- |
| 18 | + |
| 19 | +Follow the steps in the sections below to prepare an |
| 20 | +[AWS Aurora PostgreSQL](https://docs.aws.amazon.com/AmazonRDS/latest/AuroraUserGuide/CHAP_GettingStartedAurora.CreatingConnecting.AuroraPostgreSQL.html) |
| 21 | +database to work with RDI. |
| 22 | + |
| 23 | +## 1. Create an Amazon Elastic Compute Cloud instance |
| 24 | + |
| 25 | +Follow the instructions in |
| 26 | +[Amazon's documentation](https://docs.aws.amazon.com/AmazonRDS/latest/AuroraUserGuide/CHAP_GettingStartedAurora.CreatingConnecting.AuroraPostgreSQL.html#CHAP_GettingStarted.Creating.AuroraPostgreSQL.EC2) |
| 27 | +to create an Elastic Compute Cloud (EC2) instance for the database, if you don't |
| 28 | +already have one available. If you want to run the RDI PostgreSQL demo, |
| 29 | +you should select "Docker on Ubuntu 20.04 LTS" as the Amazon Machine Image (AMI) |
| 30 | +and specify a disk size of 50GB. |
| 31 | + |
| 32 | +## 2. Create a parameter group |
| 33 | + |
| 34 | +In the [Relational Database Service (RDS) console](https://console.aws.amazon.com/rds/), |
| 35 | +navigate to **Parameter groups > Create parameter group**. You will see the panel shown |
| 36 | +below: |
| 37 | + |
| 38 | +{{<image filename="images/rdi/ingest/prepsrc/aurora-pgsql/CreateParamGroup.jpg" alt="Create parameter group panel" >}} |
| 39 | + |
| 40 | +Enter the following information: |
| 41 | + |
| 42 | +| Name | Value | |
| 43 | +| :-- | :-- | |
| 44 | +| **Parameter group name** | rdi-aurora-pg | |
| 45 | +| **Description** | Enable logical replication for RDI | |
| 46 | +| **Engine Type** | Aurora PostgreSQL | |
| 47 | +| **Parameter group family** | aurora-postgresql15 | |
| 48 | +| **Type** | DB Cluster Parameter Group | |
| 49 | + |
| 50 | +Select **Create** to create the parameter group. |
| 51 | + |
| 52 | +## 3. Edit the parameter group |
| 53 | + |
| 54 | +Navigate to **Parameter groups** in the console. Select the `rdi-aurora-pg` |
| 55 | +group you have just created and then select **Edit** . You will see this panel: |
| 56 | + |
| 57 | +{{<image filename="images/rdi/ingest/prepsrc/aurora-pgsql/EditParamGroup.jpg" alt="Edit parameter group panel" >}} |
| 58 | + |
| 59 | +Search for the `rds.logical_replication` parameter and set its value to 1. Then, |
| 60 | +select **Save Changes**. |
| 61 | + |
| 62 | +## 4. Create the Aurora PostgreSQL DB cluster |
| 63 | + |
| 64 | +In the navigation pane of the console, select **Databases** and then |
| 65 | +select **Create Database**. You will see the panel shown below: |
| 66 | + |
| 67 | +{{<image filename="images/rdi/ingest/prepsrc/aurora-pgsql/CreateDB1.jpg" alt="Create Database panel" >}} |
| 68 | + |
| 69 | +Select the **Standard Create** option and select **Aurora (PostgreSQL compatible)** |
| 70 | +from the **Engine Options**. Leave the **Available Versions** popup menu with |
| 71 | +its default value. |
| 72 | + |
| 73 | +In the panel shown below, select **Dev/Test** from the **Templates**. In the |
| 74 | +**Settings**, set the **DB cluster identifier** to `gvb-database` and set the |
| 75 | +**Master Password**. Make sure your password is verified as very strong or |
| 76 | +use the **Auto generate password** option. |
| 77 | + |
| 78 | +{{<image filename="images/rdi/ingest/prepsrc/aurora-pgsql/CreateDB2.jpg" alt="Templates panel" >}} |
| 79 | + |
| 80 | +Next, scroll down to **Cluster Storage Configuration** (shown below). Ensure that |
| 81 | +**Aurora Standard** is selected in the **Configuration Options**. In the |
| 82 | +**Instance Configuration**, ensure **Memory optimized classes** is selected. |
| 83 | + |
| 84 | +{{<image filename="images/rdi/ingest/prepsrc/aurora-pgsql/CreateDB3.jpg" alt="Cluster Storage Configuration panel" >}} |
| 85 | + |
| 86 | +Then, in **Availability and Durability** (shown below), ensure **Don't create an Aurora replica** |
| 87 | +is selected. In **Connectivity**, ensure **Connect to an EC2 compute resource** is selected. |
| 88 | + |
| 89 | +{{<image filename="images/rdi/ingest/prepsrc/aurora-pgsql/CreateDB4.jpg" alt="Availability and Durability panel" >}} |
| 90 | + |
| 91 | +Further down, under **DB Subnet Group**, select **Automatic Setup**. |
| 92 | +For the **VPC Security Group**, select **Create New** and add `gvb-aurora-pg` as the |
| 93 | +**New VPC security group name**. |
| 94 | + |
| 95 | +{{<image filename="images/rdi/ingest/prepsrc/aurora-pgsql/CreateDB5.jpg" alt="DB Subnet Group panel" >}} |
| 96 | + |
| 97 | +Scrolling down to **Additional Configuration** set the **DB Cluster Parameter Group** |
| 98 | +to the value `gvb-aurora-pg` that you added earlier: |
| 99 | + |
| 100 | +{{<image filename="images/rdi/ingest/prepsrc/aurora-pgsql/CreateDB6.jpg" alt="Additional Configuration panel" >}} |
| 101 | + |
| 102 | +The final panel shows the estimated monthly costs for the database. If you are happy |
| 103 | +that the configuration is correct, select **Create Database**. |
| 104 | + |
0 commit comments