Skip to content

Commit 3c64697

Browse files
committed
more model monitoring info
1 parent 4bd9edd commit 3c64697

File tree

1 file changed

+19
-1
lines changed

1 file changed

+19
-1
lines changed

src/unify/Traits/predictions/using-predictions.md

Lines changed: 19 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -26,7 +26,25 @@ The **Explore your prediction** section of the Prediction tab visualizes predict
2626
You can then create an Audience from the group you've selected, letting you send efficient, targeted marketing campaigns within Journeys. You can also send your prediction data to downstream destinations.
2727

2828
### Model monitoring
29-
29+
30+
Predictions rank your customers by their likelihood to perform a specific conversion event, from most to least likely.
31+
32+
For each custom prediction, Segment monitors the percentile cohort where customers were ranked when they performed the predicted conversion event. After around 7 days, Segment creates a graph data visualization, allowing you to evaluate the prediction’s accuracy based on real workspace data.
33+
34+
35+
36+
For example, suppose you're predicting the likelihood of customers completing an `order_completed` event. The graph shows that:
37+
38+
- Customers in the 91–100% cohort performed the event about 6,700 times.
39+
- Customers in the 81–90% cohort performed the event about 3,900 times.
40+
- Customers in the 71–80% cohort performed the event about 3,000 times.
41+
42+
This pattern shows that the prediction was extremely accurate in identifying customers most likely to convert. Ideally, most graphs will show a similar trend, where the highest-ranked cohorts have the most conversion activity.
43+
44+
However, this pattern can change depending on how you use Predictions. For example, if you run a marketing campaign targeting the bottom 10% cohort, you might see an increase in conversions for that group instead.
45+
46+
Like any AI or machine learning tool, Predictions may not always be perfect. Start small, test your predictions, and refine your approach as needed. Model monitoring makes it easier to measure and improve the accuracy of your predictions.
47+
3048
#### Model statistics
3149

3250
The Predictions tab's **Understand your prediction** section provides insights into the performance of the underlying predictive model. This information helps you understand the data points that contribute to the prediction results.

0 commit comments

Comments
 (0)