You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/ai-studio/how-to/monitor-quality-safety.md
+16-16Lines changed: 16 additions & 16 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -8,7 +8,7 @@ ms.custom:
8
8
- ignite-2023
9
9
- build-2024
10
10
ms.topic: how-to
11
-
ms.date: 5/21/2024
11
+
ms.date: 7/31/2024
12
12
ms.reviewer: alehughes
13
13
reviewer: ahughes-msft
14
14
ms.author: mopeakande
@@ -38,7 +38,7 @@ Integrations for monitoring a prompt flow deployment allow you to:
38
38
39
39
Before following the steps in this article, make sure you have the following prerequisites:
40
40
41
-
- An Azure subscription with a valid payment method. Free or trial Azure subscriptions won't work. If you don't have an Azure subscription, create a [paid Azure account](https://azure.microsoft.com/pricing/purchase-options/pay-as-you-go) to begin.
41
+
- An Azure subscription with a valid payment method. Free or trial Azure subscriptions aren't supported for this scenario. If you don't have an Azure subscription, create a [paid Azure account](https://azure.microsoft.com/pricing/purchase-options/pay-as-you-go) to begin.
42
42
43
43
- An [Azure AI Studio hub](create-azure-ai-resource.md).
44
44
@@ -152,7 +152,7 @@ In this section, you learn how to configure monitoring for your deployed prompt
152
152
# [Studio](#tab/azure-studio)
153
153
154
154
1. From the left navigation bar, go to **Components** > **Deployments**.
155
-
1. Select the prompt flow deployment you just created.
155
+
1. Select the prompt flow deployment that you created.
156
156
1. Select **Enable** within the **Enable generation quality monitoring** box.
157
157
158
158
:::image type="content" source="../media/deploy-monitor/monitor/deployment-page-highlight-monitoring.png" alt-text="Screenshot of the deployment page highlighting generation quality monitoring." lightbox = "../media/deploy-monitor/monitor/deployment-page-highlight-monitoring.png":::
workspace_name="INSERT YOUR WORKSPACE NAME"# This is the same as your AI Studio project name
207
+
project_name="INSERT YOUR PROJECT NAME"# This is the same as your AI Studio project name
208
208
endpoint_name ="INSERT YOUR ENDPOINT NAME"# This is your deployment name without the suffix (e.g., deployment is "contoso-chatbot-1", endpoint is "contoso-chatbot")
209
209
deployment_name ="INSERT YOUR DEPLOYMENT NAME"
210
210
aoai_deployment_name ="INSERT YOUR AOAI DEPLOYMENT NAME"
After you've created your monitor, it will run daily to compute the token usage and generation quality metrics.
300
+
After you create your monitor, it will run daily to compute the token usage and generation quality metrics.
301
301
302
302
1. Go to the **Monitoring (preview)** tab from within the deployment to view the monitoring results. Here, you see an overview of monitoring results during the selected time window. You can use the date picker to change the time window of data you're monitoring. The following metrics are available in this overview:
workspace_name="INSERT YOUR WORKSPACE NAME"# This is the same as your AI Studio project name
375
-
endpoint_name ="INSERT YOUR ENDPOINT NAME" This is your deployment name without the suffix (e.g., deployment is"contoso-chatbot-1", endpoint is"contoso-chatbot")
374
+
project_name="INSERT YOUR PROJECT NAME"# This is the same as your AI Studio project name
375
+
endpoint_name ="INSERT YOUR ENDPOINT NAME"#This is your deployment name without the suffix (e.g., deployment is "contoso-chatbot-1", endpoint is "contoso-chatbot")
376
376
deployment_name ="INSERT YOUR DEPLOYMENT NAME"
377
377
378
378
# These variables can be renamed but it is not necessary
workspace_name="INSERT YOUR WORKSPACE NAME"# This is the same as your AI Studio project name
451
+
project_name="INSERT YOUR PROJECT NAME"# This is the same as your AI Studio project name
452
452
endpoint_name ="INSERT YOUR ENDPOINT NAME"# This is your deployment name without the suffix (e.g., deployment is "contoso-chatbot-1", endpoint is "contoso-chatbot")
453
453
deployment_name ="INSERT YOUR DEPLOYMENT NAME"
454
454
aoai_deployment_name ="INSERT YOUR AOAI DEPLOYMENT NAME"
0 commit comments