Skip to content

Commit 0510db0

Browse files
committed
basic pivot framework to add custom speech in foundry portal
1 parent f77a437 commit 0510db0

8 files changed

+104
-52
lines changed

articles/ai-services/speech-service/how-to-custom-speech-create-project.md

Lines changed: 2 additions & 45 deletions
Original file line numberDiff line numberDiff line change
@@ -8,7 +8,7 @@ ms.service: azure-ai-speech
88
ms.topic: how-to
99
ms.date: 9/19/2024
1010
ms.author: eur
11-
zone_pivot_groups: speech-studio-cli-rest
11+
zone_pivot_groups: foundry-speech-studio
1212
#Customer intent: As a developer, I want to learn how to create a project for custom speech so that I can train and deploy a custom model.
1313
---
1414

@@ -35,52 +35,9 @@ Select the new project by name or select **Go to project**. You'll see these men
3535

3636
::: zone-end
3737

38-
::: zone pivot="speech-cli"
38+
::: zone pivot="ai-foundry-portal"
3939

40-
To create a project, use the `spx csr project create` command. Construct the request parameters according to the following instructions:
4140

42-
- Set the required `language` parameter. The locale of the project and the contained datasets should be the same. The locale can't be changed later. The Speech CLI `language` parameter corresponds to the `locale` property in the JSON request and response.
43-
- Set the required `name` parameter. This is the name that is displayed in the Speech Studio. The Speech CLI `name` parameter corresponds to the `displayName` property in the JSON request and response.
44-
45-
Here's an example Speech CLI command that creates a project:
46-
47-
```azurecli-interactive
48-
spx csr project create --api-version v3.2 --name "My Project" --description "My Project Description" --language "en-US"
49-
```
50-
51-
You should receive a response body in the following format:
52-
53-
```json
54-
{
55-
"self": "https://eastus.api.cognitive.microsoft.com/speechtotext/v3.2/projects/0198f569-cc11-4099-a0e8-9d55bc3d0c52",
56-
"links": {
57-
"evaluations": "https://eastus.api.cognitive.microsoft.com/speechtotext/v3.2/projects/0198f569-cc11-4099-a0e8-9d55bc3d0c52/evaluations",
58-
"datasets": "https://eastus.api.cognitive.microsoft.com/speechtotext/v3.2/projects/0198f569-cc11-4099-a0e8-9d55bc3d0c52/datasets",
59-
"models": "https://eastus.api.cognitive.microsoft.com/speechtotext/v3.2/projects/0198f569-cc11-4099-a0e8-9d55bc3d0c52/models",
60-
"endpoints": "https://eastus.api.cognitive.microsoft.com/speechtotext/v3.2/projects/0198f569-cc11-4099-a0e8-9d55bc3d0c52/endpoints",
61-
"transcriptions": "https://eastus.api.cognitive.microsoft.com/speechtotext/v3.2/projects/0198f569-cc11-4099-a0e8-9d55bc3d0c52/transcriptions"
62-
},
63-
"properties": {
64-
"datasetCount": 0,
65-
"evaluationCount": 0,
66-
"modelCount": 0,
67-
"transcriptionCount": 0,
68-
"endpointCount": 0
69-
},
70-
"createdDateTime": "2024-07-14T17:15:55Z",
71-
"locale": "en-US",
72-
"displayName": "My Project",
73-
"description": "My Project Description"
74-
}
75-
```
76-
77-
The top-level `self` property in the response body is the project's URI. Use this URI to get details about the project's evaluations, datasets, models, endpoints, and transcriptions. You also use this URI to update or delete a project.
78-
79-
For Speech CLI help with projects, run the following command:
80-
81-
```azurecli-interactive
82-
spx help csr project
83-
```
8441

8542
::: zone-end
8643

articles/ai-services/speech-service/how-to-custom-speech-deploy-model.md

Lines changed: 19 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -8,7 +8,7 @@ ms.service: azure-ai-speech
88
ms.topic: how-to
99
ms.date: 9/19/2024
1010
ms.author: eur
11-
zone_pivot_groups: speech-studio-cli-rest
11+
zone_pivot_groups: foundry-speech-studio-cli-rest
1212
#Customer intent: As a developer, I want to learn how to deploy a custom speech model so that I can use it in my applications.
1313
---
1414

@@ -26,6 +26,12 @@ You can deploy an endpoint for a base or custom model, and then [update](#change
2626
2727
## Add a deployment endpoint
2828

29+
::: zone pivot="ai-foundry-portal"
30+
31+
32+
33+
::: zone-end
34+
2935
::: zone pivot="speech-studio"
3036

3137
To create a custom endpoint, follow these steps:
@@ -183,6 +189,12 @@ The top-level `self` property in the response body is the endpoint's URI. Use th
183189

184190
An endpoint can be updated to use another model that was created by the same Speech resource. As previously mentioned, you must update the endpoint's model before the [model expires](./how-to-custom-speech-model-and-endpoint-lifecycle.md).
185191

192+
::: zone pivot="ai-foundry-portal"
193+
194+
195+
196+
::: zone-end
197+
186198
::: zone pivot="speech-studio"
187199

188200
To use a new model and redeploy the custom endpoint:
@@ -304,6 +316,12 @@ The redeployment takes several minutes to complete. In the meantime, your endpoi
304316

305317
Logging data is available for export if you configured it while creating the endpoint.
306318

319+
::: zone pivot="ai-foundry-portal"
320+
321+
322+
323+
::: zone-end
324+
307325
::: zone pivot="speech-studio"
308326

309327
To download the endpoint logs:

articles/ai-services/speech-service/how-to-custom-speech-evaluate-data.md

Lines changed: 13 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -8,7 +8,7 @@ ms.service: azure-ai-speech
88
ms.topic: how-to
99
ms.date: 9/19/2024
1010
ms.author: eur
11-
zone_pivot_groups: speech-studio-cli-rest
11+
zone_pivot_groups: foundry-speech-studio-cli-rest
1212
show_latex: true
1313
no-loc: [$$, '\times', '\over']
1414
#Customer intent: As a developer, I want to test the accuracy of a custom speech model so that I can evaluate whether it meets my requirements.
@@ -24,6 +24,12 @@ In this article, you learn how to quantitatively measure and improve the accurac
2424

2525
You can test the accuracy of your custom model by creating a test. A test requires a collection of audio files and their corresponding transcriptions. You can compare a custom model's accuracy with a speech to text base model or another custom model. After you [get](#get-test-results) the test results, [evaluate the word error rate (WER)](#evaluate-word-error-rate-wer) compared to speech recognition results.
2626

27+
::: zone pivot="ai-foundry-portal"
28+
29+
30+
31+
::: zone-end
32+
2733
::: zone pivot="speech-studio"
2834

2935
Follow these steps to create a test:
@@ -227,6 +233,12 @@ The top-level `self` property in the response body is the evaluation's URI. Use
227233

228234
You should get the test results and [evaluate](#evaluate-word-error-rate-wer) the word error rate (WER) compared to speech recognition results.
229235

236+
::: zone pivot="ai-foundry-portal"
237+
238+
239+
240+
::: zone-end
241+
230242
::: zone pivot="speech-studio"
231243

232244
Follow these steps to get test results:

articles/ai-services/speech-service/how-to-custom-speech-inspect-data.md

Lines changed: 19 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -8,7 +8,7 @@ ms.service: azure-ai-speech
88
ms.topic: how-to
99
ms.date: 9/19/2024
1010
ms.author: eur
11-
zone_pivot_groups: speech-studio-cli-rest
11+
zone_pivot_groups: foundry-speech-studio-cli-rest
1212
#Customer intent: As a developer, I want to test the recognition quality of a custom speech model so that I can determine if the provided recognition result is correct.
1313
---
1414

@@ -22,6 +22,12 @@ Side-by-side model testing is useful to validate which speech recognition model
2222

2323
## Create a test
2424

25+
::: zone pivot="ai-foundry-portal"
26+
27+
28+
29+
::: zone-end
30+
2531
::: zone pivot="speech-studio"
2632

2733
Follow these instructions to create a test:
@@ -215,6 +221,12 @@ The top-level `self` property in the response body is the evaluation's URI. Use
215221

216222
You should get the test results and [inspect](#compare-transcription-with-audio) the audio datasets compared to transcription results for each model.
217223

224+
::: zone pivot="ai-foundry-portal"
225+
226+
227+
228+
::: zone-end
229+
218230
::: zone pivot="speech-studio"
219231

220232
Follow these steps to get test results:
@@ -486,6 +498,12 @@ You should receive a response body in the following format:
486498

487499
You can inspect the transcription output by each model tested, against the audio input dataset. If you included two models in the test, you can compare their transcription quality side by side.
488500

501+
::: zone pivot="ai-foundry-portal"
502+
503+
504+
505+
::: zone-end
506+
489507
::: zone pivot="speech-studio"
490508

491509
To review the quality of transcriptions:

articles/ai-services/speech-service/how-to-custom-speech-model-and-endpoint-lifecycle.md

Lines changed: 13 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -9,7 +9,7 @@ ms.service: azure-ai-speech
99
ms.topic: how-to
1010
ms.date: 9/19/2024
1111
ms.reviewer: heikora
12-
zone_pivot_groups: speech-studio-cli-rest
12+
zone_pivot_groups: foundry-speech-studio-cli-rest
1313
#Customer intent: As a developer, I want to understand the lifecycle of custom speech models and endpoints so that I can plan for the expiration of my models.
1414
---
1515

@@ -48,6 +48,12 @@ When a custom model or base model expires, it's no longer available for transcri
4848

4949
## Get base model expiration dates
5050

51+
::: zone pivot="ai-foundry-portal"
52+
53+
54+
55+
::: zone-end
56+
5157
::: zone pivot="speech-studio"
5258

5359
The last date that you could use the base model for training was shown when you created the custom model. For more information, see [Train a custom speech model](how-to-custom-speech-train-model.md).
@@ -150,6 +156,12 @@ You should receive a response body in the following format:
150156

151157
## Get custom model expiration dates
152158

159+
::: zone pivot="ai-foundry-portal"
160+
161+
162+
163+
::: zone-end
164+
153165
::: zone pivot="speech-studio"
154166

155167
Follow these instructions to get the transcription expiration date for a custom model:

articles/ai-services/speech-service/how-to-custom-speech-train-model.md

Lines changed: 19 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -8,7 +8,7 @@ ms.service: azure-ai-speech
88
ms.topic: how-to
99
ms.date: 9/19/2024
1010
ms.author: eur
11-
zone_pivot_groups: speech-studio-cli-rest
11+
zone_pivot_groups: foundry-speech-studio-cli-rest
1212
#Customer intent: As a developer, I want to train a custom speech model to improve recognition accuracy for the Microsoft base model or a custom model.
1313
---
1414

@@ -30,6 +30,12 @@ You can use a custom model for a limited time after it was trained. You must per
3030
3131
## Create a model
3232

33+
::: zone pivot="ai-foundry-portal"
34+
35+
36+
37+
::: zone-end
38+
3339
::: zone pivot="speech-studio"
3440

3541
After you upload [training datasets](./how-to-custom-speech-test-and-train.md), follow these instructions to start training your model:
@@ -223,6 +229,12 @@ The top-level `self` property in the response body is the model's URI. Use this
223229

224230
You can copy a model to another project that uses the same locale. For example, after a model is trained with audio data in a [region](regions.md#regions) with dedicated hardware for training, you can copy it to an AI Services resource for Speech in another region as needed.
225231

232+
::: zone pivot="ai-foundry-portal"
233+
234+
235+
236+
::: zone-end
237+
226238
::: zone pivot="speech-studio"
227239

228240
Follow these instructions to copy a model to a project in another region:
@@ -305,6 +317,12 @@ You should receive a response body in the following format:
305317

306318
Models might have been copied from one project using the Speech CLI or REST API, without being connected to another project. Connecting a model is a matter of updating the model with a reference to the project.
307319

320+
::: zone pivot="ai-foundry-portal"
321+
322+
323+
324+
::: zone-end
325+
308326
::: zone pivot="speech-studio"
309327

310328
If you're prompted in Speech Studio, you can connect them by selecting the **Connect** button.

articles/ai-services/speech-service/how-to-custom-speech-upload-data.md

Lines changed: 7 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -8,7 +8,7 @@ ms.service: azure-ai-speech
88
ms.topic: how-to
99
ms.date: 9/19/2024
1010
ms.author: eur
11-
zone_pivot_groups: speech-studio-cli-rest
11+
zone_pivot_groups: foundry-speech-studio-cli-rest
1212
#Customer intent: As a developer, I need to understand how to upload data to test or train a custom speech model so that I can improve the accuracy of speech recognition.
1313
---
1414

@@ -21,6 +21,12 @@ You need audio or text data for testing the accuracy of speech recognition or tr
2121
2222
## Upload datasets
2323

24+
::: zone pivot="ai-foundry-portal"
25+
26+
27+
28+
::: zone-end
29+
2430
::: zone pivot="speech-studio"
2531

2632
To upload your own datasets in Speech Studio, follow these steps:

zone-pivots/zone-pivot-groups.yml

Lines changed: 12 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -468,17 +468,28 @@ groups:
468468
title: Java
469469
- id: programming-language-python
470470
title: Python
471-
- id: speech-studio-cli-rest
471+
- id: foundry-speech-studio-cli-rest
472472
# Owner: eur
473473
title: Programming languages
474474
prompt: Choose a tool or API
475475
pivots:
476+
- id: ai-foundry-portal
477+
title: Foundry portal
476478
- id: speech-studio
477479
title: Speech Studio
478480
- id: rest-api
479481
title: REST
480482
- id: speech-cli
481483
title: Speech CLI
484+
- id: foundry-speech-studio
485+
# Owner: eur
486+
title: Programming languages
487+
prompt: Choose a tool or API
488+
pivots:
489+
- id: ai-foundry-portal
490+
title: Foundry portal
491+
- id: speech-studio
492+
title: Speech Studio
482493
- id: programming-languages-set-nineteen
483494
title: Programming languages
484495
prompt: Choose a programming language

0 commit comments

Comments
 (0)