Skip to content

Update Materialized Views Section with Backfill and Selective Sync Info #7302

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 3 commits into from
Dec 12, 2024
Merged

Update Materialized Views Section with Backfill and Selective Sync Info #7302

Changes from all commits
Commits
Show all changes
3 commits
Select commit Hold shift + click to select a range
4237066
Edit Materialized Views Section.md
charholt Dec 6, 2024
3486975
some style guide changes
pwseg Dec 12, 2024
ca8ca26
other minor cleanup
pwseg Dec 12, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
31 changes: 28 additions & 3 deletions src/unify/profiles-sync/tables.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -259,19 +259,44 @@ Segment's Identity Resolution has processed these events, which contain a `segme
## Tables Segment materializes

With Profiles Sync, you can access the following three tables that Segment materializes for a more complete view of your profile:

- [`user_traits`](#the-user_traits-table)
- [`user_identifiers`](#the-user_identifiers-table)
- [`profile_merges`](#the-profile_merges-table)

These materialized tables provide a snapshot of your Segment profiles, batch updated according to your sync schedule.
These materialized tables provide a snapshot of your Segment profiles, batch updated according to your sync schedule.

### Switching to materialized Profile Sync

If you're not using materialized views for Profile Sync and would like to switch, follow these steps:

Visit the [selective sync](/docs/unify/profiles-sync/#using-selective-sync) setup page to enable the following materialized tables, which Segment disables by default.
1. Enable Materialized Views through Selective Sync:
- Navigate to **Unify** on the sidebar and select **Profiles Sync**.
- Ensure you are viewing the Engage space you would like to enable materialized views for.
- Go to **Settings** → **Selective Sync** and enable the following tables:
- `user_traits`
- `user_identifiers`
- `profile_merges`

You can also use [historical backfill](/docs/unify/profiles-sync/profiles-sync-setup/#using-historical-backfill) with tables Segment materializes.
2. **Request a Full Profiles and Events Backfill**
- After enabling the materialized views, you'll need to ensure historical data is populated in the materialized tables.
- Write to [[email protected]](mailto:[email protected]) and request:
- A full **Profiles Backfill** to populate historical profiles data.
- An **Events Backfill** to include any relevant historical events, including a date range for Segment to pull data in for the events backfill.

3. **Verify Your Data**
- Once the backfill is complete, review the data in your warehouse to confirm all necessary historical information has been included.

> warning ""
> For materialized view tables, you must have delete permissions for your data warehouse.

### Why materialized views?

Materialized views offer several advantages:
- **Faster queries:** Pre-aggregated data reduces query complexity.
- **Improved performance:** Access enriched profiles and historical events directly without manual joins.
- **Data consistency:** Automatically updated views ensure your data stays in sync with real-time changes.


### The user_traits table

Expand Down
Loading