You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: src/connections/reverse-etl/index.md
+41-39Lines changed: 41 additions & 39 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -134,6 +134,8 @@ To check the status of your extractions:
134
134
* The load results - how many successful records were synced as well as how many records were updated, deleted, or are new.
135
135
5. If your sync failed, click the failed reason to get more details on the error and view sample payloads to help troubleshoot the issue.
136
136
137
+
#### Replays
138
+
You can choose to replay syncs. To replay a specific sync, contact [[email protected]](mailto:[email protected]). Keep in mind that triggering a replay resyncs all records for a given sync.
137
139
138
140
### Edit your model
139
141
@@ -167,44 +169,6 @@ The Segment Connections destination enables you to mold data extracted from your
167
169
> warning ""
168
170
> The Segment Connections destination sends data to Segment’s Tracking API, which has cost implications. New users count as new MTUs and each call counts as an API call. For information on how Segment calculates MTUs and API calls, please see [MTUs, Throughput and Billing](/docs/guides/usage-and-billing/mtus-and-throughput/).
169
171
170
-
## Limits
171
-
To provide consistent performance and reliability at scale, Segment enforces default use and rate limits for Reverse ETL.
172
-
173
-
### Usage limits
174
-
Reverse ETL usage limits are measured based on the number of records processed to each destination – this includes both successful and failed records. For example, if you processed 50k records to Braze and 50k records to Mixpanel, then your total Reverse ETL usage is 100k records.
175
-
176
-
Processed records represents the number of records Segment attempts to send to each destination. Keep in mind that not all processed records are successfully delivered, for example, such as when the destination experiences an issue.
177
-
178
-
Your plan determines how many Reverse ETL records you can process in one monthly billing cycle. When your limit is reached before the end of your billing period, your syncs will pause and then resume on your next billing cycle. To see how many records you’ve processed using Reverse ETL, navigate to **Settings > Usage & billing** and select the **Reverse ETL** tab.
179
-
180
-
Plan | Number of Reverse ETL records you can process to destinations per month | How to increase your number of Reverse ETL records
Free | 500K | Upgrade to the Teams plan in the Segment app by navigating to **Settings > Usage & billing**.
183
-
Teams | 1 million | Contact your sales representative to upgrade your plan to Business.
184
-
Business | 50 x the number of [MTUs](/docs/guides/usage-and-billing/mtus-and-throughput/#what-is-an-mtu) <br>or .25 x the number of monthly API calls | Contact your sales rep to upgrade your plan.
185
-
186
-
If you have a non-standard or high volume usage plan, you may have unique Reverse ETL limits or custom pricing.
187
-
188
-
### Configuration limits
189
-
190
-
Name | Details | Limit
191
-
--------- | ------- | ------
192
-
Model query length | The maximum length for the model SQL query. | 131,072 characters
193
-
Model identifier column name length | The maximum length for the ID column name. | 191 characters
194
-
Model timestamp column name length | The maximum length for the timestamp column name. | 191 characters
195
-
Sync frequency | The shortest possible duration Segment allows between syncs. | 15 minutes
196
-
197
-
### Extract limits
198
-
The extract phase is the time spent connecting to your database, executing the model query, updating internal state tables and staging the extracted records for loading.
199
-
200
-
Name | Details | Limit
201
-
----- | ------- | ------
202
-
Record count | The maximum number of records a single sync will process. Note: This is the number of records extracted from the warehouse not the limit for the number of records loaded to the destination (for example, new/update/deleted). | 30 million records
203
-
Column count | The maximum number of columns a single sync will process. | 512 columns
204
-
Column name length | The maximum length of a record column. | 128 characters
205
-
Record JSON size | The maximum size for a record when converted to JSON (some of this limit is used by Segment). | 512 KiB
206
-
Column JSON size | The maximum size of any single column value. | 128 KiB
207
-
208
172
## Supported Object and Arrays
209
173
210
174
When you set up destination actions in Reverse ETL, depending on the destination, some mapping fields may require data to be in the form of an object or array.
@@ -268,4 +232,42 @@ Customize array | This enables you to select the specific nested properties to s
268
232
> success ""
269
233
> Certain array mapping fields have a fixed list of properties they can accept. If the names of the nested properties in your array don't match the destination properties, the data won't send. Segment recommends you to use the **Customize array** option to ensure your mapping is successful.
270
234
271
-
Objects in an array don't need to have the same properties. If a user selects a missing property in the input object for a mapping field, the output object will miss the property.
235
+
Objects in an array don't need to have the same properties. If a user selects a missing property in the input object for a mapping field, the output object will miss the property.
236
+
237
+
## Limits
238
+
To provide consistent performance and reliability at scale, Segment enforces default use and rate limits for Reverse ETL.
239
+
240
+
### Usage limits
241
+
Reverse ETL usage limits are measured based on the number of records processed to each destination – this includes both successful and failed records. For example, if you processed 50k records to Braze and 50k records to Mixpanel, then your total Reverse ETL usage is 100k records.
242
+
243
+
Processed records represents the number of records Segment attempts to send to each destination. Keep in mind that not all processed records are successfully delivered, for example, such as when the destination experiences an issue.
244
+
245
+
Your plan determines how many Reverse ETL records you can process in one monthly billing cycle. When your limit is reached before the end of your billing period, your syncs will pause and then resume on your next billing cycle. To see how many records you’ve processed using Reverse ETL, navigate to **Settings > Usage & billing** and select the **Reverse ETL** tab.
246
+
247
+
Plan | Number of Reverse ETL records you can process to destinations per month | How to increase your number of Reverse ETL records
Free | 500K | Upgrade to the Teams plan in the Segment app by navigating to **Settings > Usage & billing**.
250
+
Teams | 1 million | Contact your sales representative to upgrade your plan to Business.
251
+
Business | 50 x the number of [MTUs](/docs/guides/usage-and-billing/mtus-and-throughput/#what-is-an-mtu) <br>or .25 x the number of monthly API calls | Contact your sales rep to upgrade your plan.
252
+
253
+
If you have a non-standard or high volume usage plan, you may have unique Reverse ETL limits or custom pricing.
254
+
255
+
### Configuration limits
256
+
257
+
Name | Details | Limit
258
+
--------- | ------- | ------
259
+
Model query length | The maximum length for the model SQL query. | 131,072 characters
260
+
Model identifier column name length | The maximum length for the ID column name. | 191 characters
261
+
Model timestamp column name length | The maximum length for the timestamp column name. | 191 characters
262
+
Sync frequency | The shortest possible duration Segment allows between syncs. | 15 minutes
263
+
264
+
### Extract limits
265
+
The extract phase is the time spent connecting to your database, executing the model query, updating internal state tables and staging the extracted records for loading.
266
+
267
+
Name | Details | Limit
268
+
----- | ------- | ------
269
+
Record count | The maximum number of records a single sync will process. Note: This is the number of records extracted from the warehouse not the limit for the number of records loaded to the destination (for example, new/update/deleted). | 30 million records
270
+
Column count | The maximum number of columns a single sync will process. | 512 columns
271
+
Column name length | The maximum length of a record column. | 128 characters
272
+
Record JSON size | The maximum size for a record when converted to JSON (some of this limit is used by Segment). | 512 KiB
273
+
Column JSON size | The maximum size of any single column value. | 128 KiB
0 commit comments