Skip to content

Commit 3c390de

Browse files
committed
Adding Profiles Sync section to dedupe page
1 parent c60169f commit 3c390de

File tree

1 file changed

+3
-0
lines changed

1 file changed

+3
-0
lines changed

src/guides/duplicate-data.md

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -16,5 +16,8 @@ Segment deduplicates on the event's `messageId`, _not_ on the contents of the e
1616
## Warehouse deduplication
1717
Duplicate events that are more than 24 hours apart from one another deduplicate in the Warehouse. Segment deduplicates messages going into a Warehouse based on the `messageId`, which is the `id` column in a Segment Warehouse.
1818

19+
## Profiles Sync deduplication
20+
Segment deduplicates Profiles Sync messages based on the `messageId`, which is the `id` column in a Segment Warehouse. Duplicate Profiles Sync events that are more than 24 hours apart from one another deduplicate in the Warehouse.
21+
1922
## Data Lake deduplication
2023
To ensure clean data in your Data Lake, Segment removes duplicate events at the time your Data Lake ingests data. The Data Lake deduplication process dedupes the data the Data Lake syncs within the last 7 days with Segment deduping the data based on the `messageId`.

0 commit comments

Comments
 (0)