You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: src/connections/storage/catalog/postgres/index.md
+16-12Lines changed: 16 additions & 12 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -28,13 +28,13 @@ Segment supports the following Postgres database providers:
28
28
This guide explains how to set up a Postgres database with Heroku. Heroku is a cloud-based platform-as-a-service which simplifies the process of setting up and administering a Postgres database.
29
29
30
30
> info "First sync duration"
31
-
> The initial sync between Segment and Heroku Postgres can take up to 24 hours to complete.
31
+
> The initial sync between Segment and Heroku Postgres can take up to 24 hours to complete.
32
32
33
33
1.[Sign up](https://signup.heroku.com/identity){:target="_blank"} for a Heroku account, or [log in](https://id.heroku.com/login){:target="_blank"} to an existing account.
34
34
35
35
2. On the Heroku landing page, select **New** and click **Create new app**.
36
36
37
-
3. Enter a name for your app and select the region where you want to host it. If you want to add your app to a Heroku pipeline, do so here. When you've finished updating your app's settings, click **Create app**.
37
+
3. Enter a name for your app and select the region where you want to host it. If you want to add your app to a Heroku pipeline, do so here. When you've finished updating your app's settings, click **Create app**.
38
38
39
39
4. On the Deploy page, select the Resources tab.
40
40
@@ -44,7 +44,7 @@ This guide explains how to set up a Postgres database with Heroku. Heroku is a c
44
44
45
45
7. Open the Segment app. On the Overview page, click **Add Destination**.
46
46
47
-
8. Search for and select the Postgres destination.
47
+
8. Search for and select the Postgres destination.
48
48
49
49
9. Choose the source(s) you'd like to connect to Postgres, and click **Next**.
50
50
@@ -54,10 +54,10 @@ This guide explains how to set up a Postgres database with Heroku. Heroku is a c
54
54
55
55
You can set up a Postgres database with Amazon Relational Database Service (RDS). RDS simplifies the process of setting up and administering a Postgres database.
56
56
57
-
Follow the steps in Amazon's documentation [Creating a PostgreSQL DB instance and connecting to a database on a PostgreSQL DB instance](http://docs.aws.amazon.com/AmazonRDS/latest/UserGuide/CHAP_GettingStarted.CreatingConnecting.PostgreSQL.html){:target="_blank"} to create a new PostgreSQL database in RDS. For best performance, create your database in the `US West` region.
57
+
Follow the steps in Amazon's documentation [Creating a PostgreSQL DB instance and connecting to a database on a PostgreSQL DB instance](http://docs.aws.amazon.com/AmazonRDS/latest/UserGuide/CHAP_GettingStarted.CreatingConnecting.PostgreSQL.html){:target="_blank"} to create a new PostgreSQL database in RDS. For best performance, create your database in the `US West` region.
58
58
59
59
> warning "Ensure your database is publicly accessible"
60
-
> When you create your database, ensure that the **Public access** setting is set to **Yes**. Segment requires your database to be publicly accessible in order to connect to your database.
60
+
> When you create your database, ensure that the **Public access** setting is set to **Yes**. Segment requires your database to be publicly accessible in order to connect to your database.
61
61
62
62
When you create your database, Segment recommends that you enter a **Database name** value in the **Additional options** section. This setting creates the Postgres database at instance startup.
63
63
@@ -71,17 +71,21 @@ To create a new inbound rule:
71
71
72
72
2. Open the Databases tab.
73
73
74
-
3. Select your database and open the Connectivity & security tab. Open the **Security group rules** section.
74
+
3. Select your database and open the Connectivity & security tab. Open the **Security group rules** section.
75
75
76
76
4. Click on the existing inbound security group and select the Inbound rules tab.
77
77
78
78
5. Click **Edit inbound rules** to add a new rule, and click **Add rule**.
79
79
80
80
6. Add a new rule with the following parameters:
81
-
- Select **PostgreSQL** as the type.
82
-
- For **Source**, change the custom IP to `52.25.130.38/32`. This allows Segment to connect to the instance.
83
-
84
-
When you're finished, click **Save**.
81
+
- Select **PostgreSQL** as the type.
82
+
- For **Source**, change the custom IP to `52.25.130.38/32`.
83
+
84
+
7. Add another rule with the following parameters:
85
+
- Select **PostgreSQL** as the type.
86
+
- For **Source**, change the custom IP to `34.223.203.0/28`.
87
+
88
+
8. Click **Save rules**.
85
89
86
90
## Compose Postgres
87
91
@@ -218,7 +222,7 @@ GRANT CREATE, TEMPORARY ON DATABASE <enter database name here> TO segment;
218
222
## Security
219
223
To make sure your Postgres database is secure:
220
224
- Log in with a user that has read and write permissions so that Segment can write to your database.
221
-
- Allowlist the Segment IP (`52.25.130.38/32`). Otherwise, Segment can't load your data.
225
+
- Allowlist the Segment IP addresses (`52.25.130.38/32`and`34.223.203.0/28`). Otherwise, Segment can't load your data.
222
226
- Create a service user that has `read/write` permissions.
223
227
- Always require SSL/TLS and make sure your data warehouse can only accept secure connections. Segment only connects to your data warehouse using SSL/TLS.
224
228
@@ -297,4 +301,4 @@ The syncs are failing due to a permissions issue. It looks like the user connect
297
301
298
302
To resolve these errors Segment recommends connecting to your warehouse using the owner account, or granting permissions to the current account you use to connect to Segment. You can correct these permissions by running the following SQL statement - Replace `user` with the account you use to connect to Segment, and run this statement for each schema in the warehouse.
299
303
300
-
`GRANT CREATE ON DATABASE <database_name> TO <user>`
304
+
`GRANT CREATE ON DATABASE <database_name> TO <user>`
Copy file name to clipboardExpand all lines: src/connections/storage/catalog/redshift/index.md
+1-1Lines changed: 1 addition & 1 deletion
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -86,7 +86,7 @@ Redshift clusters are created in a VPC subnet. To configure:
86
86
87
87
4. Click the Security group in the list to access its settings.
88
88
89
-
5. On the Inbound tab, add or edit a rule to enable Segment to write to your Redshift port from `52.25.130.38/32`. 
89
+
5. On the Inbound tab, add rules to enable Segment to write to your Redshift port from`34.223.203.0/28` and`52.25.130.38/32`. 
90
90
91
91
6. On the Outbound tab, ensure Redshift can make outbound requests to the Segment S3 bucket. The default behavior is to allow all outbound traffic, but security groups can limit outbound behavior. 
Copy file name to clipboardExpand all lines: src/connections/storage/warehouses/faq.md
+19-19Lines changed: 19 additions & 19 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -95,7 +95,7 @@ Segment recommends scripting any sort of additions of data you might have to war
95
95
96
96
## Which IPs should I allowlist?
97
97
98
-
You can allowlist Segment's custom IP`52.25.130.38/32` while authorizing Segment to write in to your Redshift or Postgres port.
98
+
You must allowlist Segment's custom IPs`52.25.130.38/32` and `34.223.203.0/28` while authorizing Segment to write in to your Redshift or Postgres port.
99
99
100
100
**EU workspace regions are currently in beta.** If you're in the EU region and participating in the public beta program, use CIDR `3.251.148.96/29`. To learn more about the public beta for EU workspace locations, contact your account manager.
101
101
@@ -128,48 +128,48 @@ After a source is created, you can enable or disable a warehouse sync within the
128
128
If you enabled activity notifications for your storage destination, you'll receive notifications in the Segment app for the fifth and 20th consecutive warehouse failures.
129
129
130
130
To sign up for warehouse sync notifications:
131
-
1. Open the Segment app.
132
-
2. Go to **Settings** > **User Preferences**.
131
+
1. Open the Segment app.
132
+
2. Go to **Settings** > **User Preferences**.
133
133
3. In the Activity Notifications section, select **Storage Destinations**.
134
-
4. Enable **Storage Destination Sync Failed**.
134
+
4. Enable **Storage Destination Sync Failed**.
135
135
136
136
## How is the data formatted in my warehouse?
137
137
138
-
Data in your warehouse is formatted into **schemas**, which involve a detailed description of database elements (tables, views, indexes, synonyms, etc.)
139
-
and the relationships that exist between elements. Segment's schemas use the following template: <br/>`<source>.<collection>.<property>`, for example,
138
+
Data in your warehouse is formatted into **schemas**, which involve a detailed description of database elements (tables, views, indexes, synonyms, etc.)
139
+
and the relationships that exist between elements. Segment's schemas use the following template: <br/>`<source>.<collection>.<property>`, for example,
140
140
`segment_engineering.tracks.user_id`, where source refers to the source or project name (segment_engineering), collection refers to the event (tracks),
141
-
and the property refers to the data being collected (user_id).
141
+
and the property refers to the data being collected (user_id).
142
142
143
143
Schema data for Segment warehouses is represented in snake case.
144
144
145
145
For more information about Warehouse Schemas, see the [Warehouse Schemas](/docs/connections/storage/warehouses/schema) page.
146
146
147
147
## If my syncs fail and get fixed, do I need to ask for a backfill?
148
148
149
-
If your syncs fail, you do not need to reach out to Segment Support to request a backfill. Once a successful sync takes place,
150
-
Segment automatically loads all of the data generated since the last successful sync occurred.
149
+
If your syncs fail, you do not need to reach out to Segment Support to request a backfill. Once a successful sync takes place,
150
+
Segment automatically loads all of the data generated since the last successful sync occurred.
151
151
152
152
153
153
## Can I change my schema names once they've been created?
154
154
155
-
Segment stores the name of your schema in the **SQL Settings** page. Changing the name of your schema in the app without updating the name in your data warehouse causes a new schema to form, one that doesn't contain historical data.
155
+
Segment stores the name of your schema in the **SQL Settings** page. Changing the name of your schema in the app without updating the name in your data warehouse causes a new schema to form, one that doesn't contain historical data.
156
156
157
-
To change the name of your schema without disruptions:
157
+
To change the name of your schema without disruptions:
158
158
159
-
1. Open the Segment app, select **Connections** and click **Destinations**.
159
+
1. Open the Segment app, select **Connections** and click **Destinations**.
160
160
2. Select the warehouse you'd like to rename the schema for from the list of destinations.
161
161
3. On the overview page for your source, select **Settings**.
162
-
4. Disable the **Sync Data** toggle and click **Save Settings**.
163
-
5. Select **Connections** and click **Sources**.
164
-
6. Select a source that syncs data with your warehouse from your list of sources, and select **Settings**.
162
+
4. Disable the **Sync Data** toggle and click **Save Settings**.
163
+
5. Select **Connections** and click **Sources**.
164
+
6. Select a source that syncs data with your warehouse from your list of sources, and select **Settings**.
165
165
7. Select **SQL Settings** and update the "Schema Name" field with the new name for your schema and click **Save Changes.**
166
166
> **Note**: This will set the schema name for all existing and future destinations.
167
-
8. Repeat steps six and seven until you rename all sources that sync data to your warehouse.
168
-
9. Open the third-party host of your database, and rename the schema.
167
+
8. Repeat steps six and seven until you rename all sources that sync data to your warehouse.
168
+
9. Open the third-party host of your database, and rename the schema.
169
169
10. Open the Segment app, select **Connections** and click **Destinations**.
170
170
11. Select the warehouse you disabled syncs for from the list of destinations.
171
-
3. On the overview page for your source, select **Settings**.
172
-
4. Enable the **Sync Data** toggle and click **Save Settings**.
171
+
12. On the overview page for your source, select **Settings**.
172
+
13. Enable the **Sync Data** toggle and click **Save Settings**.
173
173
174
174
## Can I change the data type of a column in the warehouse?
0 commit comments