Skip to content

Commit 2823aea

Browse files
committed
basic pivot framework to add custom speech in foundry portal
1 parent 988a2f7 commit 2823aea

File tree

6 files changed

+64
-73
lines changed

6 files changed

+64
-73
lines changed

articles/ai-services/speech-service/how-to-custom-speech-create-project.md

Lines changed: 1 addition & 69 deletions
Original file line numberDiff line numberDiff line change
@@ -50,74 +50,6 @@ In Azure AI Foundry, you can fine-tune some Azure AI services models. For exampl
5050
- **Speech Service**: An Azure AI Speech resource that was [connected after the project was created](../../ai-studio/ai-services/how-to/connect-ai-services.md#connect-azure-ai-services-after-you-create-a-project).
5151

5252
1. Enter a name and description for the fine-tuning job. Then select **Next**.
53-
1. From the new left menu in the fine-tuning page, select **Manage data** and then select **Add data**.
54-
55-
:::image type="content" source="./media/ai-studio/custom-speech/new-fine-tune-add-data.png" alt-text="Screenshot of the page with an option to add data to the custom speech project." lightbox="./media/ai-studio/custom-speech/new-fine-tune-add-data.png":::
56-
57-
1. In the **Add data** wizard, select the type of training data you want to add. In this example, we select **Audio + human-labeled transcript**. Then select **Next**.
58-
59-
:::image type="content" source="./media/ai-studio/custom-speech/new-fine-tune-add-data-select-type.png" alt-text="Screenshot of the page with an option to select the type of training data you want to add." lightbox="./media/ai-studio/custom-speech/new-fine-tune-add-data-select-type.png":::
60-
61-
1. On the **Upload your data** page, select local files, Azure Blob Storage, or other shared web locations. Then select **Next**.
62-
1. Enter a name and description for the data. Then select **Next**.
63-
1. Review the data and select **Upload**. You're taken back to the **Manage data** page. The status of the data is **Processing**.
64-
65-
:::image type="content" source="./media/ai-studio/custom-speech/new-fine-tune-add-data-status-processing.png" alt-text="Screenshot of the page that shows the status of the data as processing." lightbox="./media/ai-studio/custom-speech/new-fine-tune-add-data-status-processing.png":::
66-
67-
## Train a custom model from your data
68-
69-
1. After the data is processed, select **Train model** from the left menu. Then select **+ Train model**.
70-
71-
:::image type="content" source="./media/ai-studio/custom-speech/new-fine-tune-train-model.png" alt-text="Screenshot of the page with an option to start training for a custom speech model." lightbox="./media/ai-studio/custom-speech/new-fine-tune-train-model.png":::
72-
73-
1. In the **Train a new model** wizard, select the base model that you want to fine-tune. Then select **Next**.
74-
75-
:::image type="content" source="./media/ai-studio/custom-speech/new-fine-tune-train-model-select-base.png" alt-text="Screenshot of the page with an option to select the base model that you want to fine-tune." lightbox="./media/ai-studio/custom-speech/new-fine-tune-train-model-select-base.png":::
76-
77-
1. Select the data that you want to use for training. Then select **Next**.
78-
1. Enter a name and description for the model. Then select **Next**.
79-
1. Review the settings and select **Train a new model**. You're taken back to the **Train model** page. The status of the data is **Processing**.
80-
81-
:::image type="content" source="./media/ai-studio/custom-speech/new-fine-tune-train-model-status-processing.png" alt-text="Screenshot of the page that shows the status of the training as processing." lightbox="./media/ai-studio/custom-speech/new-fine-tune-train-model-status-processing.png":::
82-
83-
## Test the custom model
84-
85-
1. After the model is trained, select **Test models** from the left menu. Then select **+ Create test**.
86-
87-
:::image type="content" source="./media/ai-studio/custom-speech/new-fine-tune-test-model.png" alt-text="Screenshot of the page with an option to test your custom speech model." lightbox="./media/ai-studio/custom-speech/new-fine-tune-test-model.png":::
88-
89-
1. In the **Create a new test** wizard, select the test type. In this example, we select **Evaluate accuracy (Audio + transcript data)**. Then select **Next**.
90-
91-
:::image type="content" source="./media/ai-studio/custom-speech/new-fine-tune-test-model-select-type.png" alt-text="Screenshot of the page with an option to select the test type." lightbox="./media/ai-studio/custom-speech/new-fine-tune-test-model-select-type.png":::
92-
93-
1. Select the data that you want to use for testing. Then select **Next**.
94-
1. Select up to two models to evaluate and compare accuracy. In this example, we select the model that we trained and the base model. Then select **Next**.
95-
96-
:::image type="content" source="./media/ai-studio/custom-speech/new-fine-tune-test-model-select-models.png" alt-text="Screenshot of the page with an option to select up to two models to evaluate and compare accuracy." lightbox="./media/ai-studio/custom-speech/new-fine-tune-test-model-select-models.png":::
97-
98-
1. Enter a name and description for the test. Then select **Next**.
99-
1. Review the settings and select **Create test**. You're taken back to the **Test models** page. The status of the data is **Processing**.
100-
101-
:::image type="content" source="./media/ai-studio/custom-speech/new-fine-tune-test-model-status-processing.png" alt-text="Screenshot of the page that shows the status of the test as processing." lightbox="./media/ai-studio/custom-speech/new-fine-tune-test-model-status-processing.png":::
102-
103-
1. When the test status is **Succeeded**, you can view the results. Select the test to view the results.
104-
105-
106-
## Deploy the custom model
107-
108-
1. After you're satisfied with the test results, select **Deploy models** from the left menu. Then select **+ Deploy model**.
109-
110-
:::image type="content" source="./media/ai-studio/custom-speech/new-fine-tune-deploy-model.png" alt-text="Screenshot of the page with an option to deploy the custom speech model." lightbox="./media/ai-studio/custom-speech/new-fine-tune-deploy-model.png":::
111-
112-
1. In the **Deploy a new model** wizard, select the model that you want to deploy.
113-
114-
:::image type="content" source="./media/ai-studio/custom-speech/new-fine-tune-deploy-model-select-and-deploy.png" alt-text="Screenshot of the page with an option to select the model that you want to deploy." lightbox="./media/ai-studio/custom-speech/new-fine-tune-deploy-model-select-and-deploy.png":::
115-
116-
1. Enter a name and description for the deployment. Select the box to agree to the terms of use. Then select **Deploy**.
117-
118-
1. After the deployment status is **Succeeded**, you can view the deployment details. Select the deployment to view the details like the endpoint ID.
119-
120-
:::image type="content" source="./media/ai-studio/custom-speech/new-fine-tune-deploy-model-status-succeeded.png" alt-text="Screenshot of the page with an option to select the deployment to view the details like the endpoint ID." lightbox="./media/ai-studio/custom-speech/new-fine-tune-deploy-model-status-succeeded.png":::
12153

12254
## View fine-tuned models
12355

@@ -165,7 +97,7 @@ A base model or custom model deployed to an endpoint using custom speech is fixe
16597

16698
Whether you train your own model or use a snapshot of a base model, you can use the model for a limited time. For more information, see [Model and endpoint lifecycle](./how-to-custom-speech-model-and-endpoint-lifecycle.md).
16799

168-
## Next steps
100+
## Related content
169101

170102
* [Training and testing datasets](./how-to-custom-speech-test-and-train.md)
171103
* [Test model quantitatively](how-to-custom-speech-evaluate-data.md)

articles/ai-services/speech-service/how-to-custom-speech-deploy-model.md

Lines changed: 14 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -29,6 +29,20 @@ You can deploy an endpoint for a base or custom model, and then [update](#change
2929
::: zone pivot="ai-foundry-portal"
3030

3131

32+
1. After you're satisfied with the test results, select **Deploy models** from the left menu. Then select **+ Deploy model**.
33+
34+
:::image type="content" source="./media/ai-studio/custom-speech/new-fine-tune-deploy-model.png" alt-text="Screenshot of the page with an option to deploy the custom speech model." lightbox="./media/ai-studio/custom-speech/new-fine-tune-deploy-model.png":::
35+
36+
1. In the **Deploy a new model** wizard, select the model that you want to deploy.
37+
38+
:::image type="content" source="./media/ai-studio/custom-speech/new-fine-tune-deploy-model-select-and-deploy.png" alt-text="Screenshot of the page with an option to select the model that you want to deploy." lightbox="./media/ai-studio/custom-speech/new-fine-tune-deploy-model-select-and-deploy.png":::
39+
40+
1. Enter a name and description for the deployment. Select the box to agree to the terms of use. Then select **Deploy**.
41+
42+
1. After the deployment status is **Succeeded**, you can view the deployment details. Select the deployment to view the details like the endpoint ID.
43+
44+
:::image type="content" source="./media/ai-studio/custom-speech/new-fine-tune-deploy-model-status-succeeded.png" alt-text="Screenshot of the page with an option to select the deployment to view the details like the endpoint ID." lightbox="./media/ai-studio/custom-speech/new-fine-tune-deploy-model-status-succeeded.png":::
45+
3246

3347
::: zone-end
3448

articles/ai-services/speech-service/how-to-custom-speech-evaluate-data.md

Lines changed: 20 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -27,6 +27,25 @@ You can test the accuracy of your custom model by creating a test. A test requir
2727
::: zone pivot="ai-foundry-portal"
2828

2929

30+
1. After the model is trained, select **Test models** from the left menu. Then select **+ Create test**.
31+
32+
:::image type="content" source="./media/ai-studio/custom-speech/new-fine-tune-test-model.png" alt-text="Screenshot of the page with an option to test your custom speech model." lightbox="./media/ai-studio/custom-speech/new-fine-tune-test-model.png":::
33+
34+
1. In the **Create a new test** wizard, select the test type. In this example, we select **Evaluate accuracy (Audio + transcript data)**. Then select **Next**.
35+
36+
:::image type="content" source="./media/ai-studio/custom-speech/new-fine-tune-test-model-select-type.png" alt-text="Screenshot of the page with an option to select the test type." lightbox="./media/ai-studio/custom-speech/new-fine-tune-test-model-select-type.png":::
37+
38+
1. Select the data that you want to use for testing. Then select **Next**.
39+
1. Select up to two models to evaluate and compare accuracy. In this example, we select the model that we trained and the base model. Then select **Next**.
40+
41+
:::image type="content" source="./media/ai-studio/custom-speech/new-fine-tune-test-model-select-models.png" alt-text="Screenshot of the page with an option to select up to two models to evaluate and compare accuracy." lightbox="./media/ai-studio/custom-speech/new-fine-tune-test-model-select-models.png":::
42+
43+
1. Enter a name and description for the test. Then select **Next**.
44+
1. Review the settings and select **Create test**. You're taken back to the **Test models** page. The status of the data is **Processing**.
45+
46+
:::image type="content" source="./media/ai-studio/custom-speech/new-fine-tune-test-model-status-processing.png" alt-text="Screenshot of the page that shows the status of the test as processing." lightbox="./media/ai-studio/custom-speech/new-fine-tune-test-model-status-processing.png":::
47+
48+
3049

3150
::: zone-end
3251

@@ -235,6 +254,7 @@ You should get the test results and [evaluate](#evaluate-word-error-rate-wer) th
235254

236255
::: zone pivot="ai-foundry-portal"
237256

257+
When the test status is **Succeeded**, you can view the results. Select the test to view the results.
238258

239259

240260
::: zone-end

articles/ai-services/speech-service/how-to-custom-speech-train-model.md

Lines changed: 13 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -33,6 +33,19 @@ You can use a custom model for a limited time after it was trained. You must per
3333
::: zone pivot="ai-foundry-portal"
3434

3535

36+
1. After the data is processed, select **Train model** from the left menu. Then select **+ Train model**.
37+
38+
:::image type="content" source="./media/ai-studio/custom-speech/new-fine-tune-train-model.png" alt-text="Screenshot of the page with an option to start training for a custom speech model." lightbox="./media/ai-studio/custom-speech/new-fine-tune-train-model.png":::
39+
40+
1. In the **Train a new model** wizard, select the base model that you want to fine-tune. Then select **Next**.
41+
42+
:::image type="content" source="./media/ai-studio/custom-speech/new-fine-tune-train-model-select-base.png" alt-text="Screenshot of the page with an option to select the base model that you want to fine-tune." lightbox="./media/ai-studio/custom-speech/new-fine-tune-train-model-select-base.png":::
43+
44+
1. Select the data that you want to use for training. Then select **Next**.
45+
1. Enter a name and description for the model. Then select **Next**.
46+
1. Review the settings and select **Train a new model**. You're taken back to the **Train model** page. The status of the data is **Processing**.
47+
48+
:::image type="content" source="./media/ai-studio/custom-speech/new-fine-tune-train-model-status-processing.png" alt-text="Screenshot of the page that shows the status of the training as processing." lightbox="./media/ai-studio/custom-speech/new-fine-tune-train-model-status-processing.png":::
3649

3750
::: zone-end
3851

articles/ai-services/speech-service/how-to-custom-speech-upload-data.md

Lines changed: 12 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -23,7 +23,19 @@ You need audio or text data for testing the accuracy of speech recognition or tr
2323

2424
::: zone pivot="ai-foundry-portal"
2525

26+
1. From the new left menu in the fine-tuning page, select **Manage data** and then select **Add data**.
2627

28+
:::image type="content" source="./media/ai-studio/custom-speech/new-fine-tune-add-data.png" alt-text="Screenshot of the page with an option to add data to the custom speech project." lightbox="./media/ai-studio/custom-speech/new-fine-tune-add-data.png":::
29+
30+
1. In the **Add data** wizard, select the type of training data you want to add. In this example, we select **Audio + human-labeled transcript**. Then select **Next**.
31+
32+
:::image type="content" source="./media/ai-studio/custom-speech/new-fine-tune-add-data-select-type.png" alt-text="Screenshot of the page with an option to select the type of training data you want to add." lightbox="./media/ai-studio/custom-speech/new-fine-tune-add-data-select-type.png":::
33+
34+
1. On the **Upload your data** page, select local files, Azure Blob Storage, or other shared web locations. Then select **Next**.
35+
1. Enter a name and description for the data. Then select **Next**.
36+
1. Review the data and select **Upload**. You're taken back to the **Manage data** page. The status of the data is **Processing**.
37+
38+
:::image type="content" source="./media/ai-studio/custom-speech/new-fine-tune-add-data-status-processing.png" alt-text="Screenshot of the page that shows the status of the data as processing." lightbox="./media/ai-studio/custom-speech/new-fine-tune-add-data-status-processing.png":::
2739

2840
::: zone-end
2941

articles/ai-services/speech-service/toc.yml

Lines changed: 4 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -64,12 +64,12 @@ items:
6464
href: how-to-custom-speech-create-project.md
6565
- name: "Part 2: Upload training and testing datasets"
6666
href: how-to-custom-speech-upload-data.md
67-
- name: "Part 3: Test recognition quality"
67+
- name: "Part 3: Train a model"
68+
href: how-to-custom-speech-train-model.md
69+
- name: "Part 4: Test recognition quality"
6870
href: how-to-custom-speech-inspect-data.md
69-
- name: "Part 4: Test model quantitatively"
71+
- name: "Part 5: Test model quantitatively"
7072
href: how-to-custom-speech-evaluate-data.md
71-
- name: "Part 5: Train a model"
72-
href: how-to-custom-speech-train-model.md
7373
- name: "Part 6: Deploy a model"
7474
href: how-to-custom-speech-deploy-model.md
7575
- name: Custom speech datasets

0 commit comments

Comments
 (0)