Skip to content

Commit faad52f

Browse files
cursoragentsahil
andcommitted
Add Gladia as a multilingual transcriber option
Co-authored-by: sahil <[email protected]>
1 parent 0d37c64 commit faad52f

File tree

2 files changed

+12
-11
lines changed

2 files changed

+12
-11
lines changed

fern/customization/multilingual.mdx

Lines changed: 8 additions & 8 deletions
Original file line numberDiff line numberDiff line change
@@ -16,7 +16,7 @@ Configure your voice assistant to communicate in multiple languages with automat
1616
- Test and optimize multilingual performance
1717

1818
<Note>
19-
**Multilingual Support:** Multiple providers support automatic language detection. **Deepgram** (Nova 2, Nova 3 with "Multi" setting) and **Google STT** (with "Multilingual" setting) both offer automatic language detection for seamless multilingual conversations.
19+
**Multilingual Support:** Multiple providers support automatic language detection. **Deepgram** (Nova 2, Nova 3 with "Multi" setting), **Google STT** (with "Multilingual" setting), and **Gladia** (automatic language detection) all offer seamless multilingual conversations.
2020
</Note>
2121

2222
## Configure automatic language detection
@@ -28,10 +28,10 @@ Set up your transcriber to automatically detect and process multiple languages.
2828
1. Navigate to **Assistants** in your [Vapi Dashboard](https://dashboard.vapi.ai/)
2929
2. Create a new assistant or edit an existing one
3030
3. In the **Transcriber** section:
31-
- **Provider**: Select `Deepgram` (recommended) or `Google`
32-
- **Model**: For Deepgram, choose `Nova 2` or `Nova 3`; for Google, choose `Latest`
33-
- **Language**: Set to `Multi` (Deepgram) or `Multilingual` (Google)
34-
4. **Other providers**: Single language only, no automatic detection
31+
- **Provider**: Select `Deepgram` (recommended), `Google`, or `Gladia`
32+
- **Model**: For Deepgram, choose `Nova 2` or `Nova 3`; for Google, choose `Latest`; for Gladia, choose your preferred Gladia model
33+
- **Language / Mode**: Set `Multi` (Deepgram), `Multilingual` (Google), or enable automatic language detection (Gladia)
34+
4. **Other providers**: May require a single language and not auto-detect
3535
5. Click **Save** to apply the configuration
3636
</Tab>
3737
<Tab title="TypeScript (Server SDK)">
@@ -114,7 +114,7 @@ Set up your transcriber to automatically detect and process multiple languages.
114114
</Tabs>
115115

116116
<Note>
117-
**Provider Performance:** **Deepgram** offers the best balance of speed and multilingual accuracy. **Google** provides broader language support but may be slower. Both providers support automatic language detection within conversations.
117+
**Provider Performance:** **Deepgram** offers the best balance of speed and multilingual accuracy. **Google** provides broader language support but may be slower. **Gladia** offers excellent automatic language recognition and code-switching with strong accuracy reported by customers. All three support automatic language detection within conversations.
118118
</Note>
119119

120120
## Set up multilingual voices
@@ -463,7 +463,7 @@ Validate your configuration with different languages and scenarios.
463463
| **Assembly AI** | ❌ English only | English | No multilingual support |
464464
| **Azure STT** | ❌ Single language | 100+ | Many languages, but no auto-detection |
465465
| **OpenAI Whisper** | ❌ Single language | 90+ | Many languages, but no auto-detection |
466-
| **Gladia** | ❌ Single language | 80+ | Many languages, but no auto-detection |
466+
| **Gladia** | ✅ Full auto-detection | 90+ | Supports automatic language detection and code-switching |
467467
| **Speechmatics** | ❌ Single language | 50+ | Many languages, but no auto-detection |
468468
| **Talkscriber** | ❌ Single language | 40+ | Many languages, but no auto-detection |
469469

@@ -481,7 +481,7 @@ Validate your configuration with different languages and scenarios.
481481
<AccordionGroup>
482482
<Accordion title="Language detection is inaccurate">
483483
**Solutions:**
484-
- Use Deepgram (Nova 2/Nova 3 with "Multi") or Google STT (with "Multilingual")
484+
- Use Deepgram (Nova 2/Nova 3 with "Multi"), Google STT (with "Multilingual"), or Gladia (automatic language detection)
485485
- Ensure high-quality audio input for better detection accuracy
486486
- Test with native speakers of target languages
487487
- Consider provider-specific language combinations for optimal results

fern/providers/transcriber/gladia.mdx

Lines changed: 4 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -21,7 +21,7 @@ Gladia provides a comprehensive suite of AI-driven tools:
2121

2222
**Speech-to-Text:**
2323

24-
Gladia’s core offering is its AI-powered speech-to-text technology, delivering highly accurate and real-time transcription. This service supports 99 languages and includes speaker diarization and code-switching.
24+
Gladia’s core offering is its AI-powered speech-to-text technology, delivering highly accurate and real-time transcription. This service supports automatic language detection (including code‑switching within a conversation) and 90+ languages, and includes speaker diarization.
2525

2626
**Audio Intelligence:**
2727

@@ -54,8 +54,9 @@ Gladia excels in providing real-time transcription and translation:
5454

5555
**Multilingual Support:**
5656

57-
- 99 Languages: Supports a wide range of languages and dialects.
58-
- Real-time Translation: Near-instantaneous translation for diverse applications.
57+
- Automatic language recognition: Detects the spoken language automatically and handles code‑switching
58+
- 90+ languages: Supports a wide range of languages and dialects
59+
- Real-time Translation: Near-instantaneous translation for diverse applications
5960

6061
**Use Cases:**
6162

0 commit comments

Comments
 (0)