Skip to content

Commit 21da0a1

Browse files
Merge pull request #281656 from eric-urban/eur/stt-overview
STT overview refresh
2 parents 9aa0433 + 5cac72c commit 21da0a1

File tree

1 file changed

+49
-25
lines changed

1 file changed

+49
-25
lines changed

articles/ai-services/speech-service/speech-to-text.md

Lines changed: 49 additions & 25 deletions
Original file line numberDiff line numberDiff line change
@@ -6,37 +6,41 @@ author: eric-urban
66
manager: nitinme
77
ms.service: azure-ai-speech
88
ms.topic: overview
9-
ms.date: 5/21/2024
9+
ms.date: 7/23/2024
1010
ms.author: eur
1111
---
1212

1313
# What is speech to text?
1414

15-
In this overview, you learn about the benefits and capabilities of the speech to text feature of the Speech service, which is part of Azure AI services. Speech to text can be used for [real-time](#real-time-speech-to-text), [batch transcription](#batch-transcription-api), or [fast transcription](./fast-transcription-create.md) of audio streams into text.
15+
Azure AI Speech service offers advanced speech to text capabilities. This feature supports both real-time and batch transcription, providing versatile solutions for converting audio streams into text.
1616

17-
> [!NOTE]
18-
> To compare pricing of [real-time](#real-time-speech-to-text), [batch transcription](#batch-transcription-api), and [fast transcription](./fast-transcription-create.md), see [Speech service pricing](https://azure.microsoft.com/pricing/details/cognitive-services/speech-services/).
17+
## Core Features
1918

20-
For a full list of available speech to text languages, see [Language and voice support](language-support.md?tabs=stt).
19+
The speech to text service offers the following core features:
20+
- [Real-time](#real-time-speech-to-text) transcription: Instant transcription with intermediate results for live audio inputs.
21+
- [Fast transcription](#fast-transcription-preview): Fastest synchronous output for situations with predictable latency.
22+
- [Batch transcription](#batch-transcription-api): Efficient processing for large volumes of prerecorded audio.
23+
- [Custom speech](#custom-speech): Models with enhanced accuracy for specific domains and conditions.
2124

2225
## Real-time speech to text
2326

24-
With real-time speech to text, the audio is transcribed as speech is recognized from a microphone or file. Use real-time speech to text for applications that need to transcribe audio in real-time such as:
25-
- Transcriptions, captions, or subtitles for live meetings
26-
- [Diarization](get-started-stt-diarization.md)
27-
- [Pronunciation assessment](how-to-pronunciation-assessment.md)
28-
- Contact center agents assist
29-
- Dictation
30-
- Voice agents
27+
Real-time speech to text transcribes audio as it's recognized from a microphone or file. It's ideal for applications requiring immediate transcription, such as:
28+
- **Transcriptions, captions, or subtitles for live meetings**: Real-time audio transcription for accessibility and record-keeping.
29+
- **Diarization**: Identifying and distinguishing between different speakers in the audio.
30+
- **Pronunciation assessment**: Evaluating and providing feedback on pronunciation accuracy.
31+
- **Call center agents assist**: Providing real-time transcription to assist customer service representatives.
32+
- **Dictation**: Transcribing spoken words into written text for documentation purposes.
33+
- **Voice agents**: Enabling interactive voice response systems to transcribe user queries and commands.
3134

32-
Real-time speech to text is available via the [Speech SDK](speech-sdk.md) and the [Speech CLI](spx-overview.md).
35+
Real-time speech to text can be accessed via the Speech SDK, Speech CLI, and REST API, allowing integration into various applications and workflows.
36+
Real-time speech to text is available via the [Speech SDK](speech-sdk.md), the [Speech CLI](spx-overview.md), and REST APIs such as the [Fast transcription API](fast-transcription-create.md).
3337

3438
## Fast transcription (Preview)
3539

36-
Fast transcription API is used to transcribe audio files with returning results synchronously and much faster than real-time audio. Use fast transcription in the scenarios that you need the transcript of an audio recording as quickly as possible with predictable latency, such as:
40+
Fast transcription API is used to transcribe audio files with returning results synchronously and faster than real-time audio. Use fast transcription in the scenarios that you need the transcript of an audio recording as quickly as possible with predictable latency, such as:
3741

38-
- Quick audio or video transcription, subtitles, and edit.
39-
- Video translation
42+
- **Quick audio or video transcription and subtitles**: Quickly get a transcription of an entire video or audio file in one go.
43+
- **Video translation**: Immediately get new subtitles for a video if you have audio in different languages.
4044

4145
> [!NOTE]
4246
> Fast transcription API is only available via the speech to text REST API version 2024-05-15-preview and later.
@@ -45,14 +49,15 @@ To get started with fast transcription, see [use the fast transcription API (pre
4549

4650
## Batch transcription API
4751

48-
[Batch transcription](batch-transcription.md) is used to transcribe a large amount of audio in storage. You can point to audio files with a shared access signature (SAS) URI and asynchronously receive transcription results. Use batch transcription for applications that need to transcribe audio in bulk such as:
49-
- Transcriptions, captions, or subtitles for prerecorded audio
50-
- Contact center post-call analytics
51-
- Diarization
52+
[Batch transcription](batch-transcription.md) is designed for transcribing large amounts of audio stored in files. This method processes audio asynchronously and is suited for:
53+
- **Transcriptions, captions, or subtitles for prerecorded audio**: Converting stored audio content into text.
54+
- **Contact center post-call analytics**: Analyzing recorded calls to extract valuable insights.
55+
- **Diarization**: Differentiating between speakers in recorded audio.
5256

5357
Batch transcription is available via:
54-
- [Speech to text REST API](rest-speech-to-text.md): To get started, see [How to use batch transcription](batch-transcription.md) and [Batch transcription samples (REST)](https://github.com/Azure-Samples/cognitive-services-speech-sdk/tree/master/samples/batch).
55-
- The [Speech CLI](spx-overview.md) supports both real-time and batch transcription. For Speech CLI help with batch transcriptions, run the following command:
58+
- [Speech to text REST API](rest-speech-to-text.md): Facilitates batch processing with the flexibility of RESTful calls. To get started, see [How to use batch transcription](batch-transcription.md) and [Batch transcription samples](https://github.com/Azure-Samples/cognitive-services-speech-sdk/tree/master/samples/batch).
59+
- [Speech CLI](spx-overview.md): Supports both real-time and batch transcription, making it easy to manage transcription tasks. For Speech CLI help with batch transcriptions, run the following command:
60+
5661
```azurecli-interactive
5762
spx help batch transcription
5863
```
@@ -66,9 +71,27 @@ With [custom speech](./custom-speech-overview.md), you can evaluate and improve
6671
6772
Out of the box, speech recognition utilizes a Universal Language Model as a base model that is trained with Microsoft-owned data and reflects commonly used spoken language. The base model is pretrained with dialects and phonetics representing various common domains. When you make a speech recognition request, the most recent base model for each [supported language](language-support.md?tabs=stt) is used by default. The base model works well in most speech recognition scenarios.
6873
69-
A custom model can be used to augment the base model to improve recognition of domain-specific vocabulary specific to the application by providing text data to train the model. It can also be used to improve recognition based for the specific audio conditions of the application by providing audio data with reference transcriptions. For more information, see [custom speech](./custom-speech-overview.md) and [Speech to text REST API](rest-speech-to-text.md).
74+
Custom speech allows you to tailor the speech recognition model to better suit your application's specific needs. This can be particularly useful for:
75+
- **Improving recognition of domain-specific vocabulary**: Train the model with text data relevant to your field.
76+
- **Enhancing accuracy for specific audio conditions**: Use audio data with reference transcriptions to refine the model.
77+
78+
For more information about custom speech, see the [custom speech overview](./custom-speech-overview.md) and the [speech to text REST API](rest-speech-to-text.md) documentation.
79+
80+
For details about customization options per language and locale, see the [language and voice support for the Speech service](./language-support.md?tabs=stt) documentation.
81+
82+
## Usage Examples
83+
84+
Here are some practical examples of how you can utilize Azure AI speech to text:
7085
71-
Customization options vary by language or locale. To verify support, see [Language and voice support for the Speech service](./language-support.md?tabs=stt).
86+
| Use case | Scenario | Solution |
87+
| --- | --- | --- |
88+
| **Live meeting transcriptions and captions** | A virtual event platform needs to provide real-time captions for webinars. | Integrate real-time speech to text using the Speech SDK to transcribe spoken content into captions displayed live during the event. |
89+
| **Customer service enhancement** | A call center wants to assist agents by providing real-time transcriptions of customer calls. | Use real-time speech to text via the Speech CLI to transcribe calls, enabling agents to better understand and respond to customer queries. |
90+
| **Video subtitling** | A video-hosting platform wants to quickly generate a set of subtitles for a video. | Use fast transcription to quickly get a set of subtitles for the entire video. |
91+
| **Educational tools** | An e-learning platform aims to provide transcriptions for video lectures. | Apply batch transcription through the speech to text REST API to process prerecorded lecture videos, generating text transcripts for students. |
92+
| **Healthcare documentation** | A healthcare provider needs to document patient consultations. | Use real-time speech to text for dictation, allowing healthcare professionals to speak their notes and have them transcribed instantly. Use a custom model to enhance recognition of specific medical terms. |
93+
| **Media and entertainment** | A media company wants to create subtitles for a large archive of videos. | Use batch transcription to process the video files in bulk, generating accurate subtitles for each video. |
94+
| **Market research** | A market research firm needs to analyze customer feedback from audio recordings. | Employ batch transcription to convert audio feedback into text, enabling easier analysis and insights extraction. |
7295
7396
## Responsible AI
7497
@@ -79,7 +102,8 @@ An AI system includes not only the technology, but also the people who use it, t
79102
* [Integration and responsible use](/legal/cognitive-services/speech-service/speech-to-text/guidance-integration-responsible-use?context=/azure/ai-services/speech-service/context/context)
80103
* [Data, privacy, and security](/legal/cognitive-services/speech-service/speech-to-text/data-privacy-security?context=/azure/ai-services/speech-service/context/context)
81104
82-
## Next steps
105+
## Related content
83106
84107
- [Get started with speech to text](get-started-speech-to-text.md)
85108
- [Create a batch transcription](batch-transcription-create.md)
109+
- For detailed pricing information, visit the [Speech service pricing](https://azure.microsoft.com/pricing/details/cognitive-services/speech-services/) page.

0 commit comments

Comments
 (0)