Skip to content

Commit 48b36a1

Browse files
authored
Merge pull request #5010 from eric-urban/eur/custom-speech-foundry-refresh
custom speech foundry refresh
2 parents bdbd313 + c9ff61c commit 48b36a1

33 files changed

+59
-60
lines changed

articles/ai-services/speech-service/how-to-custom-speech-create-project.md

Lines changed: 4 additions & 14 deletions
Original file line numberDiff line numberDiff line change
@@ -6,7 +6,7 @@ author: eric-urban
66
manager: nitinme
77
ms.service: azure-ai-speech
88
ms.topic: how-to
9-
ms.date: 2/25/2025
9+
ms.date: 5/19/2025
1010
ms.author: eur
1111
zone_pivot_groups: foundry-speech-studio
1212
#Customer intent: As a developer, I want to learn how to customize speech models with fine-tuning so that I can train and deploy a custom model.
@@ -35,19 +35,9 @@ In the [Azure AI Foundry portal](https://ai.azure.com), you can fine-tune some A
3535
1. Select **Fine-tuning** from the left pane.
3636
1. Select **AI Service fine-tuning** > **+ Fine-tune**.
3737

38-
:::image type="content" source="./media/ai-foundry/custom-speech/fine-tune-azure-ai-services.png" alt-text="Screenshot of the page to select fine-tuning of Azure AI Services models." lightbox="./media/ai-foundry/custom-speech/fine-tune-azure-ai-services.png":::
38+
:::image type="content" source="./media/custom-speech/ai-foundry/fine-tune-azure-ai-services.png" alt-text="Screenshot of the page to select fine-tuning of Azure AI Services models." lightbox="./media/custom-speech/ai-foundry/fine-tune-azure-ai-services.png":::
3939

40-
1. In the wizard, select **Speech to text (speech recognition)** for custom speech. Then select **Next**.
41-
1. Select the connected service resource that you want to use for fine-tuning.
42-
43-
:::image type="content" source="./media/ai-foundry/custom-speech/new-fine-tune-select-connection.png" alt-text="Screenshot of the page to select the connected service resource that you want to use for fine-tuning." lightbox="./media/ai-foundry/custom-speech/new-fine-tune-select-connection.png":::
44-
45-
> [!IMPORTANT]
46-
> If you train a custom model with audio data, select a service resource in a region with dedicated hardware for training audio data. See footnotes in the [regions](regions.md#regions) table for more information.
47-
48-
You can choose from the following connected resource types:
49-
- **AI Service**: The Azure AI Services multi-service resource that [came with the Azure AI Foundry project](../../ai-services/connect-services-ai-foundry-portal.md#connect-azure-ai-services-when-you-create-a-project-for-the-first-time).
50-
- **Speech Service**: An Azure AI Speech resource that was [connected after the project was created](../../ai-services/connect-services-ai-foundry-portal.md#connect-azure-ai-services-after-you-create-a-project).
40+
1. In the wizard, select **Custom Speech (speech to text fine-tuning)** for custom speech. Then select **Next**.
5141

5242
1. Enter the language, name, and description for the fine-tuning job. Then select **Create**.
5343

@@ -67,7 +57,7 @@ After fine-tuning, you can access your custom speech models and deployments from
6757
1. Select **Fine-tuning** from the left pane.
6858
1. Select **AI Service fine-tuning**.
6959

70-
:::image type="content" source="./media/ai-foundry/custom-speech/fine-tune-succeeded-list.png" alt-text="Screenshot of the page where you can view fine-tuned AI services models." lightbox="./media/ai-foundry/custom-speech/fine-tune-succeeded-list.png":::
60+
:::image type="content" source="./media/custom-speech/ai-foundry/fine-tune-succeeded-list.png" alt-text="Screenshot of the page where you can view fine-tuned AI services models." lightbox="./media/custom-speech/ai-foundry/fine-tune-succeeded-list.png":::
7161

7262
::: zone-end
7363

articles/ai-services/speech-service/how-to-custom-speech-deploy-model.md

Lines changed: 7 additions & 8 deletions
Original file line numberDiff line numberDiff line change
@@ -6,7 +6,7 @@ author: eric-urban
66
manager: nitinme
77
ms.service: azure-ai-speech
88
ms.topic: how-to
9-
ms.date: 2/25/2025
9+
ms.date: 5/19/2025
1010
ms.author: eur
1111
zone_pivot_groups: foundry-speech-studio-cli-rest
1212
#Customer intent: As a developer, I want to learn how to deploy a custom speech model so that I can use it in my applications.
@@ -29,22 +29,21 @@ You can deploy an endpoint for a base or custom model, and then [update](#change
2929
::: zone pivot="ai-foundry-portal"
3030

3131
1. Sign in to the [Azure AI Foundry portal](https://ai.azure.com).
32-
1. Select **Fine-tuning** from the left pane.
33-
1. Select **AI Service fine-tuning**.
34-
1. Select the custom model that you want to manage from the **Model name** column.
35-
1. After you're satisfied with the test results, select **Deploy models** from the left menu. Then select **+ Deploy model**.
32+
1. Select **Fine-tuning** from the left pane and then select **AI Service fine-tuning**.
33+
1. Select the custom speech fine-tuning task (by model name) that you [started as described in the how to start custom speech fine-tuning article](./how-to-custom-speech-create-project.md).
34+
1. Select **Deploy models** > **+ Deploy models**.
3635

37-
:::image type="content" source="./media/ai-foundry/custom-speech/new-fine-tune-deploy-model.png" alt-text="Screenshot of the page with an option to deploy the custom speech model." lightbox="./media/ai-foundry/custom-speech/new-fine-tune-deploy-model.png":::
36+
:::image type="content" source="./media/custom-speech/ai-foundry/new-fine-tune-deploy-model.png" alt-text="Screenshot of the page with an option to deploy the custom speech model." lightbox="./media/custom-speech/ai-foundry/new-fine-tune-deploy-model.png":::
3837

3938
1. In the **Deploy a new model** wizard, select the model that you want to deploy.
4039

41-
:::image type="content" source="./media/ai-foundry/custom-speech/new-fine-tune-deploy-model-select-and-deploy.png" alt-text="Screenshot of the page with an option to select the model that you want to deploy." lightbox="./media/ai-foundry/custom-speech/new-fine-tune-deploy-model-select-and-deploy.png":::
40+
:::image type="content" source="./media/custom-speech/ai-foundry/new-fine-tune-deploy-model-select-and-deploy.png" alt-text="Screenshot of the page with an option to select the model that you want to deploy." lightbox="./media/custom-speech/ai-foundry/new-fine-tune-deploy-model-select-and-deploy.png":::
4241

4342
1. Enter a name and description for the deployment. Select the box to agree to the terms of use. Then select **Deploy**.
4443

4544
1. After the deployment status is **Succeeded**, you can view the deployment details. Select the deployment to view the details like the endpoint ID.
4645

47-
:::image type="content" source="./media/ai-foundry/custom-speech/new-fine-tune-deploy-model-status-succeeded.png" alt-text="Screenshot of the page with an option to select the deployment to view the details like the endpoint ID." lightbox="./media/ai-foundry/custom-speech/new-fine-tune-deploy-model-status-succeeded.png":::
46+
:::image type="content" source="./media/custom-speech/ai-foundry/new-fine-tune-deploy-model-status-succeeded.png" alt-text="Screenshot of the page with an option to select the deployment to view the details like the endpoint ID." lightbox="./media/custom-speech/ai-foundry/new-fine-tune-deploy-model-status-succeeded.png":::
4847

4948

5049
::: zone-end

articles/ai-services/speech-service/how-to-custom-speech-display-text-format.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -6,7 +6,7 @@ author: eric-urban
66
manager: nitinme
77
ms.service: azure-ai-speech
88
ms.topic: how-to
9-
ms.date: 2/25/2025
9+
ms.date: 5/19/2025
1010
ms.author: eur
1111
#Customer intent: As a developer, I want to learn how to prepare display text format training data for custom speech so that I can customize the display text formatting pipeline for my specific scenarios.
1212
---

articles/ai-services/speech-service/how-to-custom-speech-evaluate-data.md

Lines changed: 12 additions & 9 deletions
Original file line numberDiff line numberDiff line change
@@ -6,7 +6,7 @@ author: eric-urban
66
manager: nitinme
77
ms.service: azure-ai-speech
88
ms.topic: how-to
9-
ms.date: 2/25/2025
9+
ms.date: 5/19/2025
1010
ms.author: eur
1111
zone_pivot_groups: foundry-speech-studio-cli-rest
1212
show_latex: true
@@ -24,29 +24,32 @@ In this article, you learn how to quantitatively measure and improve the accurac
2424

2525
You can test the accuracy of your custom model by creating a test. A test requires a collection of audio files and their corresponding transcriptions. You can compare a custom model's accuracy with a speech to text base model or another custom model. After you [get](#get-test-results) the test results, [evaluate the word error rate (WER)](#evaluate-word-error-rate-wer) compared to speech recognition results.
2626

27+
After you [upload training and testing datasets](how-to-custom-speech-upload-data.md), you can create a test.
28+
2729
::: zone pivot="ai-foundry-portal"
2830

31+
To test your fine-tuned custom speech model, follow these steps:
32+
2933
1. Sign in to the [Azure AI Foundry portal](https://ai.azure.com).
30-
1. Select **Fine-tuning** from the left pane.
31-
1. Select **AI Service fine-tuning**.
32-
1. Select the custom model that you want to manage from the **Model name** column.
33-
1. After the model is trained, select **Test models** from the left menu. Then select **+ Create test**.
34+
1. Select **Fine-tuning** from the left pane and then select **AI Service fine-tuning**.
35+
1. Select the custom speech fine-tuning task (by model name) that you [started as described in the how to start custom speech fine-tuning article](./how-to-custom-speech-create-project.md).
36+
1. Select **Test models** > **+ Create test**.
3437

35-
:::image type="content" source="./media/ai-foundry/custom-speech/new-fine-tune-test-model.png" alt-text="Screenshot of the page with an option to test your custom speech model." lightbox="./media/ai-foundry/custom-speech/new-fine-tune-test-model.png":::
38+
:::image type="content" source="./media/custom-speech/ai-foundry/new-fine-tune-test-model.png" alt-text="Screenshot of the page with an option to test your custom speech model." lightbox="./media/custom-speech/ai-foundry/new-fine-tune-test-model.png":::
3639

3740
1. In the **Create a new test** wizard, select the test type. For an accuracy (quantitative) test, select **Evaluate accuracy (Audio + transcript data)**. Then select **Next**.
3841

39-
:::image type="content" source="./media/ai-foundry/custom-speech/new-fine-tune-test-model-select-type.png" alt-text="Screenshot of the page with an option to select the test type." lightbox="./media/ai-foundry/custom-speech/new-fine-tune-test-model-select-type.png":::
42+
:::image type="content" source="./media/custom-speech/ai-foundry/new-fine-tune-test-model-select-type.png" alt-text="Screenshot of the page with an option to select the test type." lightbox="./media/custom-speech/ai-foundry/new-fine-tune-test-model-select-type.png":::
4043

4144
1. Select the data that you want to use for testing. Then select **Next**.
4245
1. Select up to two models to evaluate and compare accuracy. In this example, we select the model that we trained and the base model. Then select **Next**.
4346

44-
:::image type="content" source="./media/ai-foundry/custom-speech/new-fine-tune-test-model-select-models.png" alt-text="Screenshot of the page with an option to select up to two models to evaluate and compare accuracy." lightbox="./media/ai-foundry/custom-speech/new-fine-tune-test-model-select-models.png":::
47+
:::image type="content" source="./media/custom-speech/ai-foundry/new-fine-tune-test-model-select-models.png" alt-text="Screenshot of the page with an option to select up to two models to evaluate and compare accuracy." lightbox="./media/custom-speech/ai-foundry/new-fine-tune-test-model-select-models.png":::
4548

4649
1. Enter a name and description for the test. Then select **Next**.
4750
1. Review the settings and select **Create test**. You're taken back to the **Test models** page. The status of the data is **Processing**.
4851

49-
:::image type="content" source="./media/ai-foundry/custom-speech/new-fine-tune-test-model-status-processing.png" alt-text="Screenshot of the page that shows the status of the test as processing." lightbox="./media/ai-foundry/custom-speech/new-fine-tune-test-model-status-processing.png":::
52+
:::image type="content" source="./media/custom-speech/ai-foundry/new-fine-tune-test-model-status-processing.png" alt-text="Screenshot of the page that shows the status of the test as processing." lightbox="./media/custom-speech/ai-foundry/new-fine-tune-test-model-status-processing.png":::
5053

5154
::: zone-end
5255

articles/ai-services/speech-service/how-to-custom-speech-human-labeled-transcriptions.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -6,7 +6,7 @@ author: eric-urban
66
manager: nitinme
77
ms.service: azure-ai-speech
88
ms.topic: how-to
9-
ms.date: 2/25/2025
9+
ms.date: 5/19/2025
1010
ms.author: eur
1111
#Customer intent: As a developer, I need to understand how to create human-labeled transcriptions for my audio data so that I can improve speech recognition accuracy.
1212
---

articles/ai-services/speech-service/how-to-custom-speech-inspect-data.md

Lines changed: 10 additions & 7 deletions
Original file line numberDiff line numberDiff line change
@@ -6,7 +6,7 @@ author: eric-urban
66
manager: nitinme
77
ms.service: azure-ai-speech
88
ms.topic: how-to
9-
ms.date: 2/25/2025
9+
ms.date: 5/19/2025
1010
ms.author: eur
1111
zone_pivot_groups: foundry-speech-studio-cli-rest
1212
#Customer intent: As a developer, I want to test the recognition quality of a custom speech model so that I can determine if the provided recognition result is correct.
@@ -22,21 +22,24 @@ Side-by-side model testing is useful to validate which speech recognition model
2222

2323
## Create a test
2424

25+
After you [upload training and testing datasets](how-to-custom-speech-upload-data.md), you can create a test.
26+
2527
::: zone pivot="ai-foundry-portal"
2628

29+
To test your fine-tuned custom speech model, follow these steps:
30+
2731
1. Sign in to the [Azure AI Foundry portal](https://ai.azure.com).
28-
1. Select **Fine-tuning** from the left pane.
29-
1. Select **AI Service fine-tuning**.
30-
1. Select the custom model that you want to manage from the **Model name** column.
31-
1. After the model is trained, select **Test models** from the left menu. Then select **+ Create test**.
32+
1. Select **Fine-tuning** from the left pane and then select **AI Service fine-tuning**.
33+
1. Select the custom speech fine-tuning task (by model name) that you [started as described in the how to start custom speech fine-tuning article](./how-to-custom-speech-create-project.md).
34+
1. Select **Test models** > **+ Create test**.
3235

33-
:::image type="content" source="./media/ai-foundry/custom-speech/new-fine-tune-test-model.png" alt-text="Screenshot of the page with an option to test your custom speech model." lightbox="./media/ai-foundry/custom-speech/new-fine-tune-test-model.png":::
36+
:::image type="content" source="./media/custom-speech/ai-foundry/new-fine-tune-test-model.png" alt-text="Screenshot of the page with an option to test your custom speech model." lightbox="./media/custom-speech/ai-foundry/new-fine-tune-test-model.png":::
3437

3538
1. In the **Create a new test** wizard, select the test type. For a quality test, select **Inspect quality (Audio-only data)**. Then select **Next**.
3639
1. Select the data that you want to use for testing. Then select **Next**.
3740
1. Select up to two models to evaluate and compare accuracy. In this example, we select the model that we trained and the base model. Then select **Next**.
3841

39-
:::image type="content" source="./media/ai-foundry/custom-speech/new-fine-tune-test-model-select-models.png" alt-text="Screenshot of the page with an option to select up to two models to evaluate and compare accuracy." lightbox="./media/ai-foundry/custom-speech/new-fine-tune-test-model-select-models.png":::
42+
:::image type="content" source="./media/custom-speech/ai-foundry/new-fine-tune-test-model-select-models.png" alt-text="Screenshot of the page with an option to select up to two models to evaluate and compare accuracy." lightbox="./media/custom-speech/ai-foundry/new-fine-tune-test-model-select-models.png":::
4043

4144
1. Enter a name and description for the test. Then select **Next**.
4245
1. Review the settings and select **Create test**. You're taken back to the **Test models** page. The status of the data is **Processing**.

articles/ai-services/speech-service/how-to-custom-speech-model-and-endpoint-lifecycle.md

Lines changed: 1 addition & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -7,7 +7,7 @@ manager: nitinme
77
ms.author: eur
88
ms.service: azure-ai-speech
99
ms.topic: how-to
10-
ms.date: 2/25/2025
10+
ms.date: 5/19/2025
1111
ms.reviewer: heikora
1212
zone_pivot_groups: foundry-speech-studio-cli-rest
1313
#Customer intent: As a developer, I want to understand the lifecycle of custom speech models and endpoints so that I can plan for the expiration of my models.
@@ -45,7 +45,6 @@ When a custom model or base model expires, it's no longer available for transcri
4545
|Custom endpoint|Speech recognition requests fall back to the most recent base model for the same [locale](language-support.md?tabs=stt). You get results, but recognition might not accurately transcribe your domain data. |Update the endpoint's model as described in the [Deploy a custom speech model](how-to-custom-speech-deploy-model.md) guide. |
4646
|Batch transcription |[Batch transcription](batch-transcription.md) requests for expired models fail with a 4xx error. |In each [Transcriptions_Create](/rest/api/speechtotext/transcriptions/create) REST API request body, set the `model` property to a base model or custom model that isn't expired. Otherwise don't include the `model` property to always use the latest base model. |
4747

48-
4948
## Get base model expiration dates
5049

5150
The last date that you could use the base model for training was shown when you created the custom model. For more information, see [Train a custom speech model](how-to-custom-speech-train-model.md).

articles/ai-services/speech-service/how-to-custom-speech-test-and-train.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -6,7 +6,7 @@ author: eric-urban
66
manager: nitinme
77
ms.service: azure-ai-speech
88
ms.topic: how-to
9-
ms.date: 2/25/2025
9+
ms.date: 5/19/2025
1010
ms.author: eur
1111
#Customer intent: As a developer, I need to understand the types of training and testing data that I can use for a custom speech project, along with how to use and manage that data.
1212
---

articles/ai-services/speech-service/how-to-custom-speech-train-model.md

Lines changed: 7 additions & 8 deletions
Original file line numberDiff line numberDiff line change
@@ -6,7 +6,7 @@ author: eric-urban
66
manager: nitinme
77
ms.service: azure-ai-speech
88
ms.topic: how-to
9-
ms.date: 2/25/2025
9+
ms.date: 5/19/2025
1010
ms.author: eur
1111
zone_pivot_groups: foundry-speech-studio-cli-rest
1212
#Customer intent: As a developer, I want to train a custom speech model to improve recognition accuracy for the Microsoft base model or a custom model.
@@ -33,22 +33,21 @@ You can use a custom model for a limited time after it was trained. You must per
3333
::: zone pivot="ai-foundry-portal"
3434

3535
1. Sign in to the [Azure AI Foundry portal](https://ai.azure.com).
36-
1. Select **Fine-tuning** from the left pane.
37-
1. Select **AI Service fine-tuning**.
38-
1. Select the custom model that you want to manage from the **Model name** column.
39-
1. After the data is processed, select **Train model** from the left menu. Then select **+ Train model**.
36+
1. Select **Fine-tuning** from the left pane and then select **AI Service fine-tuning**.
37+
1. Select the custom speech fine-tuning task (by model name) that you [started as described in the how to start custom speech fine-tuning article](./how-to-custom-speech-create-project.md).
38+
1. Select **Train model** > **+ Train model**.
4039

41-
:::image type="content" source="./media/ai-foundry/custom-speech/new-fine-tune-train-model.png" alt-text="Screenshot of the page with an option to start training for a custom speech model." lightbox="./media/ai-foundry/custom-speech/new-fine-tune-train-model.png":::
40+
:::image type="content" source="./media/custom-speech/ai-foundry/new-fine-tune-train-model.png" alt-text="Screenshot of the page with an option to start training for a custom speech model." lightbox="./media/custom-speech/ai-foundry/new-fine-tune-train-model.png":::
4241

4342
1. In the **Train a new model** wizard, select the base model that you want to fine-tune. Then select **Next**.
4443

45-
:::image type="content" source="./media/ai-foundry/custom-speech/new-fine-tune-train-model-select-base.png" alt-text="Screenshot of the page with an option to select the base model that you want to fine-tune." lightbox="./media/ai-foundry/custom-speech/new-fine-tune-train-model-select-base.png":::
44+
:::image type="content" source="./media/custom-speech/ai-foundry/new-fine-tune-train-model-select-base.png" alt-text="Screenshot of the page with an option to select the base model that you want to fine-tune." lightbox="./media/custom-speech/ai-foundry/new-fine-tune-train-model-select-base.png":::
4645

4746
1. Select the data that you want to use for training. Then select **Next**.
4847
1. Enter a name and description for the model. Then select **Next**.
4948
1. Review the settings and select **Train a new model**. You're taken back to the **Train model** page. The status of the data is **Processing**.
5049

51-
:::image type="content" source="./media/ai-foundry/custom-speech/new-fine-tune-train-model-status-processing.png" alt-text="Screenshot of the page that shows the status of the training as processing." lightbox="./media/ai-foundry/custom-speech/new-fine-tune-train-model-status-processing.png":::
50+
:::image type="content" source="./media/custom-speech/ai-foundry/new-fine-tune-train-model-status-processing.png" alt-text="Screenshot of the page that shows the status of the training as processing." lightbox="./media/custom-speech/ai-foundry/new-fine-tune-train-model-status-processing.png":::
5251

5352
::: zone-end
5453

0 commit comments

Comments
 (0)