You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/ai-services/speech-service/whisper-overview.md
+10-11Lines changed: 10 additions & 11 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -6,21 +6,21 @@ author: eric-urban
6
6
manager: nitinme
7
7
ms.service: azure-ai-speech
8
8
ms.topic: overview
9
-
ms.date: 8/20/2024
9
+
ms.date: 9/18/2024
10
10
ms.author: eur
11
11
---
12
12
13
13
# What is the Whisper model?
14
14
15
15
The Whisper model is a speech to text model from OpenAI that you can use to transcribe audio files. The model is trained on a large dataset of English audio and text. The model is optimized for transcribing audio files that contain speech in English. The model can also be used to transcribe audio files that contain speech in other languages. The output of the model is English text.
16
16
17
-
Whisper models are available via the Azure OpenAI Service or via Azure AI Speech. The features differ for those offerings. In Azure AI Speech, Whisper is just one of several models that you can use for speech to text.
17
+
Whisper models are available via the Azure OpenAI Service or via Azure AI Speech. The features differ for those offerings. In [Azure AI Speech (batch transcription)](./batch-transcription-create.md#use-a-whisper-model), Whisper is just one of several models that you can use for speech to text.
18
18
19
19
You might ask:
20
20
21
21
- Is the Whisper Model a good choice for my scenario, or is an Azure AI Speech model better? What are the API comparisons between the two types of models?
22
22
23
-
- If I want to use the Whisper Model, should I use it via the Azure OpenAI Service or via Azure AI Speech? What are the scenarios that guide me to use one or the other?
23
+
- If I want to use the Whisper Model, should I use it via the Azure OpenAI Service or via Azure AI Speech? What are the scenarios that guide me to use one or the other?
24
24
25
25
## Whisper model or Azure AI Speech models
26
26
@@ -29,7 +29,7 @@ Either the Whisper model or the Azure AI Speech models are appropriate depending
29
29
| Scenario | Whisper model | Azure AI Speech models |
| Real-time transcriptions, captions, and subtitles for audio and video. | Not available | Recommended |
32
-
| Transcriptions, captions, and subtitles for prerecorded audio and video. | The Whisper model via [Azure OpenAI](../openai/whisper-quickstart.md) is recommended for fast processing of individual audio files. The Whisper model via [Azure AI Speech](./batch-transcription-create.md#use-a-whisper-model) is recommended for batch processing of large files. For more information, see [Whisper model via Azure AI Speech or via Azure OpenAI Service?](#whisper-model-via-azure-ai-speech-or-via-azure-openai-service)| Recommended for batch processing of large files, diarization, and word level timestamps. |
32
+
| Transcriptions, captions, and subtitles for prerecorded audio and video. | The Whisper model via [Azure OpenAI](../openai/whisper-quickstart.md) is recommended for fast processing of individual audio files. The Whisper model via [Azure AI Speech (batch transcription)](./batch-transcription-create.md#use-a-whisper-model) is recommended for batch processing of large files. For more information, see [Whisper model via Azure AI Speech batch transcription or via Azure OpenAI Service?](#whisper-model-via-azure-ai-speech-or-via-azure-openai-service)| Recommended for batch processing of large files, diarization, and word level timestamps. |
33
33
| Transcript of phone call recordings and analytics such as call summary, sentiment, key topics, and custom insights. | Available | Recommended |
34
34
| Real-time transcription and analytics to assist call center agents with customer questions. | Not available | Recommended |
35
35
| Transcript of meeting recordings and analytics such as meeting summary, meeting chapters, and action item extraction. | Available | Recommended |
@@ -43,27 +43,26 @@ Either the Whisper model or the Azure AI Speech models are appropriate depending
43
43
44
44
## Whisper model via Azure AI Speech or via Azure OpenAI Service?
45
45
46
-
If you decide to use the Whisper model, you have two options. You can choose whether to use the Whisper Model via [Azure OpenAI](../openai/whisper-quickstart.md) or via [Azure AI Speech](./batch-transcription-create.md#use-a-whisper-model). In either case, the readability of the transcribed text is the same. You can input mixed language audio and the output is in English.
46
+
If you decide to use the Whisper model, you have two options. You can choose whether to use the Whisper Model via [Azure OpenAI](../openai/whisper-quickstart.md) or via [Azure AI Speech (batch transcription)](./batch-transcription-create.md#use-a-whisper-model). In either case, the readability of the transcribed text is the same. You can input mixed language audio and the output is in English.
47
47
48
48
Whisper Model via Azure OpenAI Service might be best for:
49
49
- Quickly transcribing audio files one at a time
50
50
- Translate audio from other languages into English
51
51
- Provide a prompt to the model to guide the output
Whisper Model via Azure AI Speech might be best for:
54
+
Whisper Model via Azure AI Speech batch transcription might be best for:
55
55
- Transcribing files larger than 25MB (up to 1GB). The file size limit for the Azure OpenAI Whisper model is 25 MB.
56
-
- Transcribing large batches of audio files
56
+
- Transcribing large batches of audio files.
57
57
- Diarization to distinguish between the different speakers participating in the conversation. The Speech service provides information about which speaker was speaking a particular part of transcribed speech. The Whisper model via Azure OpenAI doesn't support diarization.
58
58
- Word-level timestamps
59
-
- Supported file formats: mp3, wav, and ogg
60
-
- Customization of the Whisper base model to improve accuracy for your scenario (coming soon)
59
+
- Supported file formats: mp3, wav, and ogg.
61
60
62
61
Regional support is another consideration.
63
-
- The Whisper model via Azure OpenAI Service is available in the following regions: East US 2, India South, North Central, Norway East, Sweden Central, and West Europe.
62
+
- The Whisper model via Azure OpenAI Service is available in the following regions: East US 2, India South, North Central, Norway East, Sweden Central, Switzerland North, and West Europe.
64
63
- The Whisper model via Azure AI Speech is available in the following regions: Australia East, East US, North Central US, South Central US, Southeast Asia, UK South, and West Europe.
65
64
66
-
## Next steps
65
+
## Related content
67
66
68
67
-[Use Whisper models via the Azure AI Speech batch transcription API](./batch-transcription-create.md#use-a-whisper-model)
69
68
-[Try the speech to text quickstart for Whisper via Azure OpenAI](../openai/whisper-quickstart.md)
0 commit comments