You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/ai-services/speech-service/custom-neural-voice.md
+5Lines changed: 5 additions & 0 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -48,6 +48,11 @@ Here's an overview of the steps to create a custom neural voice in Speech Studio
48
48
49
49
You can tune, adjust, and use your custom voice, similarly as you would use a prebuilt neural voice. Convert text into speech in real-time, or generate audio content offline with text input. You use the [REST API](./rest-text-to-speech.md), the [Speech SDK](./get-started-text-to-speech.md), or the [Speech Studio](https://speech.microsoft.com/audiocontentcreation).
50
50
51
+
> [!TIP]
52
+
> You can also use the Speech SDK and custom voice REST API to train a custom neural voice.
53
+
>
54
+
> Check out the code samples in the [Speech SDK repository on GitHub](https://github.com/Azure-Samples/cognitive-services-speech-sdk/blob/master/samples/custom-voice/README.md) to see how to use personal voice in your application.
55
+
51
56
The style and the characteristics of the trained voice model depend on the style and the quality of the recordings from the voice talent used for training. However, you can make several adjustments by using [SSML (Speech Synthesis Markup Language)](./speech-synthesis-markup.md?tabs=csharp) when you make the API calls to your voice model to generate synthetic speech. SSML is the markup language used to communicate with the text to speech service to convert text into audio. The adjustments you can make include change of pitch, rate, intonation, and pronunciation correction. If the voice model is built with multiple styles, you can also use SSML to switch the styles.
## Available text to speech voices in Azure AI services
26
29
27
30
You might ask: If I want to use an OpenAI text to speech voice, should I use it via the Azure OpenAI Service or via Azure AI Speech? What are the scenarios that guide me to use one or the other?
Copy file name to clipboardExpand all lines: articles/ai-services/speech-service/personal-voice-overview.md
+3Lines changed: 3 additions & 0 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -63,6 +63,9 @@ To get started, here's a summary of the steps to create a personal voice:
63
63
64
64
Once you have a personal voice, you can [use it](./personal-voice-how-to-use.md) to synthesize speech in any of the 91 languages supported across 100+ locales. A locale tag isn't required. Personal voice uses automatic language detection at the sentence level. For more information, see [use personal voice in your application](./personal-voice-how-to-use.md).
65
65
66
+
> [!TIP]
67
+
> Check out the code samples in the [Speech SDK repository on GitHub](https://github.com/Azure-Samples/cognitive-services-speech-sdk/blob/master/samples/custom-voice/README.md) to see how to use personal voice in your application.
Copy file name to clipboardExpand all lines: articles/ai-studio/how-to/monitor-quality-safety.md
+63-64Lines changed: 63 additions & 64 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -1,33 +1,87 @@
1
1
---
2
-
title: Monitor quality and safety of deployed applications
2
+
title: Monitor quality and safety of deployed prompt flow applications
3
3
titleSuffix: Azure AI Studio
4
-
description: Learn how to monitor quality and safety of deployed applications with Azure AI Studio.
4
+
description: Learn how to monitor quality and safety of deployed prompt flow applications with Azure AI Studio.
5
5
manager: scottpolly
6
6
ms.service: azure-ai-studio
7
7
ms.custom:
8
8
- ignite-2023
9
9
ms.topic: how-to
10
-
ms.date: 11/15/2023
10
+
ms.date: 2/7/2024
11
11
ms.reviewer: fasantia
12
12
ms.author: mopeakande
13
13
author: msakande
14
14
---
15
15
16
-
# Monitor quality and safety of deployed applications
16
+
# Monitor quality and safety of deployed prompt flow applications
17
17
18
-
Monitoring models that are deployed in production is an essential part of the generative AI application lifecycle. Changes in data and consumer behavior can influence your application over time, resulting in outdated systems that negatively affect business outcomes and expose organizations to compliance, economic, and reputational risks.
18
+
Monitoring models that are deployed in production is an essential part of the generative AI application lifecycle. Changes in data and consumer behavior can influence your application over time, resulting in outdated systems that negatively affect business outcomes and expose organizations to compliance, economic, and reputation risks.
19
19
20
20
Azure AI model monitoring for generative AI applications makes it easier for you to monitor your applications in production for safety and quality on a cadence to ensure it's delivering maximum business value.
21
21
22
-
Capabilities and integrations include:
23
-
- Collect production data using Model data collector from a prompt flow deployment.
22
+
Capabilities and integrations for monitoring a prompt flow deployment include:
23
+
- Collect production data using the model data collector.
24
24
- Apply Responsible AI evaluation metrics such as groundedness, coherence, fluency, relevance, and similarity, which are interoperable with prompt flow evaluation metrics.
25
25
- Preconfigured alerts and defaults to run monitoring on a recurring basis.
26
26
- Consume result and configure advanced behavior in Azure AI Studio.
27
27
28
+
## Set up monitoring for prompt flow
29
+
30
+
Follow these steps to set up monitoring for your prompt flow deployment:
31
+
32
+
1. Confirm your flow runs successfully, and that the required inputs and outputs are configured for the [metrics you want to assess](#evaluation-metrics). The minimum required parameters of collecting only inputs and outputs provide only two metrics: coherence and fluency. You must configure your flow according to the [flow and metric configuration requirements](#flow-and-metric-configuration-requirements).
33
+
34
+
:::image type="content" source="../media/deploy-monitor/monitor/user-experience.png" alt-text="Screenshot of prompt flow editor with deploy button." lightbox = "../media/deploy-monitor/monitor/user-experience.png":::
35
+
36
+
1. Deploy your flow. By default, both inferencing data collection and application insights are enabled automatically. These are required for the creation of your monitor.
37
+
38
+
:::image type="content" source="../media/deploy-monitor/monitor/basic-settings.png" alt-text="Screenshot of basic settings in the deployment wizard." lightbox = "../media/deploy-monitor/monitor/basic-settings.png":::
39
+
40
+
1. By default, all outputs of your deployment are collected using Azure AI's Model Data Collector. As an optional step, you can enter the advanced settings to confirm that your desired columns (for example, context of ground truth) are included in the endpoint response.
41
+
42
+
Your deployed flow needs to be configured in the following way:
43
+
- Flow inputs & outputs: You need to name your flow outputs appropriately and remember these column names when creating your monitor. In this article, we use the following settings:
- Data collection: The **inferencing data collection** toggle must be enabled using Model Data Collector
49
+
50
+
- Outputs: In the prompt flow deployment wizard, confirm the required outputs are selected (such as completion, context, and ground_truth) that meet your metric configuration requirements.
51
+
52
+
1. Test your deployment in the deployment **Test** tab.
53
+
54
+
:::image type="content" source="../media/deploy-monitor/monitor/test-deploy.png" alt-text="Screenshot of the deployment test page." lightbox = "../media/deploy-monitor/monitor/test-deploy.png":::
55
+
56
+
> [!NOTE]
57
+
> Monitoring requires the endpoint to be used at least 10 times to collect enough data to provide insights. If you'd like to test sooner, manually send about 50 rows in the 'test' tab before running the monitor.
58
+
59
+
1. Create your monitor by either enabling from the deployment details page, or the **Monitoring** tab.
60
+
61
+
:::image type="content" source="../media/deploy-monitor/monitor/enable-monitoring.png" alt-text="Screenshot of the button to enable monitoring." lightbox = "../media/deploy-monitor/monitor/enable-monitoring.png":::
62
+
63
+
1. Ensure your columns are mapped from your flow as defined in the previous requirements.
64
+
65
+
:::image type="content" source="../media/deploy-monitor/monitor/column-map.png" alt-text="Screenshot of columns mapped for monitoring metrics." lightbox = "../media/deploy-monitor/monitor/column-map.png":::
66
+
67
+
1. View your monitor in the **Monitor** tab.
68
+
69
+
:::image type="content" source="../media/deploy-monitor/monitor/monitor-metrics.png" alt-text="Screenshot of the monitoring result metrics." lightbox = "../media/deploy-monitor/monitor/monitor-metrics.png":::
70
+
71
+
By default, operational metrics such as requests per minute and request latency show up. The default safety and quality monitoring signal are configured with a 10% sample rate and run on your default workspace Azure Open AI connection.
72
+
73
+
Your monitor is created with default settings:
74
+
- 10% sample rate
75
+
- 4/5 (thresholds / recurrence)
76
+
- Weekly recurrence on Monday mornings
77
+
- Alerts are delivered to the inbox of the person that triggered the monitor.
78
+
79
+
To view more details about your monitoring metrics, you can follow the link to navigate to monitoring in Azure Machine Learning studio, which is a separate studio that allows for more customizations.
80
+
81
+
28
82
## Evaluation metrics
29
83
30
-
Metrics are generated by the following state-of-the-art GPT language models configured with specific evaluation instructions (prompt templates) which act as evaluator models for sequence-to-sequence tasks. This technique has shown strong empirical results and high correlation with human judgment when compared to standard generative AI evaluation metrics. For more information about prompt flow evaluation, see [Submit bulk test and evaluate a flow](./flow-bulk-test-evaluation.md) and [evaluation and monitoring metrics for generative AI](../concepts/evaluation-metrics-built-in.md).
84
+
Metrics are generated by the following state-of-the-art GPT language models configured with specific evaluation instructions (prompt templates) which act as evaluator models for sequence-to-sequence tasks. This technique has strong empirical results and high correlation with human judgment when compared to standard generative AI evaluation metrics. For more information about prompt flow evaluation, see [Submit bulk test and evaluate a flow](./flow-bulk-test-evaluation.md) and [evaluation and monitoring metrics for generative AI](../concepts/evaluation-metrics-built-in.md).
31
85
32
86
These GPT models are supported with monitoring and configured as your Azure OpenAI resource:
33
87
@@ -53,7 +107,7 @@ When creating your flow, you need to ensure your column names are mapped. The fo
53
107
|------|------------|----------|
54
108
| Prompt text | The original prompt given (also known as "inputs" or "question") | Required |
55
109
| Completion text | The final completion from the API call that is returned (also known as "outputs" or "answer") | Required |
56
-
| Context text | Any context data that is sent to the API call, together with original prompt. For example, if you hope to get search results only from certain certified information sources/website, you can define in the evaluation steps. This is an optional step that can be configured through prompt flow. | Optional |
110
+
| Context text | Any context data that is sent to the API call, together with original prompt. For example, if you hope to get search results only from certain certified information sources/website, you can define in the evaluation steps. | Optional |
57
111
| Ground truth text | The user-defined text as the "source of truth" | Optional |
58
112
59
113
What parameters are configured in your data asset dictates what metrics you can produce, according to this table:
@@ -68,61 +122,6 @@ What parameters are configured in your data asset dictates what metrics you can
68
122
69
123
For more information, see [question answering metric requirements](evaluate-generative-ai-app.md#question-answering-metric-requirements).
70
124
71
-
## User Experience
72
-
73
-
Confirm your flow runs successfully, and that the required inputs and outputs are configured for the metrics you want to assess. The minimum required parameters of collecting only inputs and outputs provide only two metrics: coherence and fluency. You must configure your flow according to the [prior guidance](#flow-and-metric-configuration-requirements).
74
-
75
-
:::image type="content" source="../media/deploy-monitor/monitor/user-experience.png" alt-text="Screenshot of prompt flow editor with deploy button." lightbox = "../media/deploy-monitor/monitor/user-experience.png":::
76
-
77
-
Deploy your flow. By default, both inferencing data collection and application insights are enabled automatically. These are required for the creation of your monitor.
78
-
79
-
:::image type="content" source="../media/deploy-monitor/monitor/basic-settings.png" alt-text="Screenshot of basic settings in the deployment wizard." lightbox = "../media/deploy-monitor/monitor/basic-settings.png":::
80
-
81
-
By default, all outputs of your deployment are collected using Azure AI's Model Data Collector. As an optional step, you can enter the advanced settings to confirm that your desired columns (for example, context of ground truth) are included in the endpoint response.
82
-
83
-
In summary, your deployed flow needs to be configured in the following way:
84
-
85
-
- Flow inputs & outputs: You need to name your flow outputs appropriately and remember these column names when creating your monitor. In this article, we use the following:
- Data collection: in the "Deployment" (Step #2 of the prompt flow deployment wizard), the 'inference data collection' toggle must be enabled using Model Data Collector
91
-
92
-
- Outputs: In the Outputs (Step #3 of the prompt flow deployment wizard), confirm you have selected the required outputs listed above (for example, completion | context | ground_truth) that meet your metric configuration requirements.
93
-
94
-
Test your deployment in the deployment **Test** tab.
95
-
96
-
:::image type="content" source="../media/deploy-monitor/monitor/test-deploy.png" alt-text="Screenshot of the deployment test page." lightbox = "../media/deploy-monitor/monitor/test-deploy.png":::
97
-
98
-
99
-
> [!NOTE]
100
-
> Monitoring requires the endpoint to be used at least 10 times to collect enough data to provide insights. If you'd like to test sooner, manually send about 50 rows in the 'test' tab before running the monitor.
101
-
102
-
Create your monitor by either enabling from the deployment details page, or the **Monitoring** tab.
103
-
104
-
:::image type="content" source="../media/deploy-monitor/monitor/enable-monitoring.png" alt-text="Screenshot of the button to enable monitoring." lightbox = "../media/deploy-monitor/monitor/enable-monitoring.png":::
105
-
106
-
Ensure your columns are mapped from your flow as defined in the previous requirements.
107
-
108
-
:::image type="content" source="../media/deploy-monitor/monitor/column-map.png" alt-text="Screenshot of columns mapped for monitoring metrics." lightbox = "../media/deploy-monitor/monitor/column-map.png":::
109
-
110
-
111
-
View your monitor in the **Monitor** tab.
112
-
113
-
:::image type="content" source="../media/deploy-monitor/monitor/monitor-metrics.png" alt-text="Screenshot of the monitoring result metrics." lightbox = "../media/deploy-monitor/monitor/monitor-metrics.png":::
114
-
115
-
By default, operational metrics such as requests per minute and request latency show up. The default safety and quality monitoring signal are configured with a 10% sample rate and will run on your default workspace Azure Open AI connection.
116
-
117
-
Your monitor is created with default settings:
118
-
- 10% sample rate
119
-
- 4/5 (thresholds / recurrence)
120
-
- Weekly recurrence on Monday mornings
121
-
- Alerts are delivered to the inbox of the person that triggered the monitor.
122
-
123
-
To view more details about your monitoring metrics, you can follow the link to navigate to monitoring in Azure Machine Learning studio, which is a separate studio that allows for more customizations.
124
-
125
-
126
125
## Next steps
127
126
128
127
- Learn more about what you can do in [Azure AI Studio](../what-is-ai-studio.md)
Copy file name to clipboardExpand all lines: articles/application-gateway/configure-application-gateway-with-private-frontend-ip.md
+5-5Lines changed: 5 additions & 5 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -1,26 +1,26 @@
1
1
---
2
2
title: Configure an internal load balancer (ILB) endpoint
3
3
titleSuffix: Azure Application Gateway
4
-
description: This article provides information on how to configure Application Gateway Standard v1 with a private frontend IP address
4
+
description: This article provides information on how to configure Application Gateway Standard v2 with a private frontend IP address
5
5
services: application-gateway
6
6
author: greg-lindsay
7
7
ms.service: application-gateway
8
8
ms.topic: how-to
9
-
ms.date: 01/11/2022
9
+
ms.date: 02/07/2024
10
10
ms.author: greglin
11
11
---
12
12
13
13
# Configure an application gateway with an internal load balancer (ILB) endpoint
14
14
15
-
Azure Application Gateway Standard v1 can be configured with an Internet-facing VIP or with an internal endpoint that isn't exposed to the Internet. An internal endpoint uses a private IP address for the frontend, which is also known as an *internal load balancer (ILB) endpoint*.
15
+
Azure Application Gateway Standard v2 can be configured with an Internet-facing VIP or with an internal endpoint that isn't exposed to the Internet. An internal endpoint uses a private IP address for the frontend, which is also known as an *internal load balancer (ILB) endpoint*.
16
16
17
17
Configuring the gateway using a frontend private IP address is useful for internal line-of-business applications that aren't exposed to the Internet. It's also useful for services and tiers within a multi-tier application that are in a security boundary that isn't exposed to the Internet but:
18
18
19
19
- still require round-robin load distribution
20
20
- session stickiness
21
21
- or Transport Layer Security (TLS) termination (previously known as Secure Sockets Layer (SSL)).
22
22
23
-
This article guides you through the steps to configure a Standard v1 Application Gateway with an ILB using the Azure portal.
23
+
This article guides you through the steps to configure a Standard v2 Application Gateway with an ILB using the Azure portal.
0 commit comments