Skip to content

Commit c88cb50

Browse files
Merge pull request #1571 from lgayhardt/onlineeval2
AI Studio: Online Eval
2 parents a7f83b0 + 42af9f5 commit c88cb50

File tree

7 files changed

+375
-1
lines changed

7 files changed

+375
-1
lines changed

articles/ai-studio/how-to/develop/trace-production-sdk.md

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -21,6 +21,9 @@ After deploying a Generative AI APP in production, you might want to enhance you
2121

2222
In this article, you learn to enable tracing, collect aggregated metrics, and collect user feedback during inference time of your flow deployment.
2323

24+
> [!NOTE]
25+
> For an improved way to perform continuous monitoring of deployed applications (other than prompt flow), consider using [Azure AI online evaluation](../online-evaluation.md).
26+
2427
## Prerequisites
2528

2629
- The Azure CLI and the Azure Machine Learning extension to the Azure CLI.

articles/ai-studio/how-to/monitor-quality-safety.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -22,7 +22,7 @@ author: msakande
2222
Monitoring applications that are deployed to production is an essential part of the generative AI application lifecycle. Changes in data and consumer behavior can influence your application over time, resulting in outdated systems that negatively affect business outcomes and expose organizations to compliance, economic, and reputation risks.
2323

2424
> [!NOTE]
25-
> For an improved way to perform continuous monitoring of deployed applications (other than prompt flow), consider using Azure AI online evaluation.
25+
> For an improved way to perform continuous monitoring of deployed applications (other than prompt flow), consider using [Azure AI online evaluation](./online-evaluation.md).
2626
2727
Azure AI monitoring for generative AI applications enables you to monitor your applications in production for token usage, generation quality, and operational metrics.
2828

articles/ai-studio/how-to/online-evaluation.md

Lines changed: 369 additions & 0 deletions
Large diffs are not rendered by default.
6.74 MB
Loading
2.48 MB
Loading
369 KB
Loading

articles/ai-studio/toc.yml

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -301,6 +301,8 @@ items:
301301
href: how-to/develop/trace-local-sdk.md
302302
- name: Visualize your traces
303303
href: how-to/develop/visualize-traces.md
304+
- name: Continuously monitor your applications
305+
href: how-to/online-evaluation.md
304306
- name: Evaluate generative AI apps
305307
items:
306308
- name: Evaluations concepts

0 commit comments

Comments
 (0)