Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
16 changes: 8 additions & 8 deletions fern/customization/multilingual.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -16,7 +16,7 @@ Configure your voice assistant to communicate in multiple languages with automat
- Test and optimize multilingual performance

<Note>
**Multilingual Support:** Multiple providers support automatic language detection. **Deepgram** (Nova 2, Nova 3 with "Multi" setting) and **Google STT** (with "Multilingual" setting) both offer automatic language detection for seamless multilingual conversations.
**Multilingual Support:** Multiple providers support automatic language detection. **Deepgram** (Nova 2, Nova 3 with "Multi" setting), **Google STT** (with "Multilingual" setting), and **Gladia** (automatic language detection) all offer seamless multilingual conversations.
</Note>

## Configure automatic language detection
Expand All @@ -28,10 +28,10 @@ Set up your transcriber to automatically detect and process multiple languages.
1. Navigate to **Assistants** in your [Vapi Dashboard](https://dashboard.vapi.ai/)
2. Create a new assistant or edit an existing one
3. In the **Transcriber** section:
- **Provider**: Select `Deepgram` (recommended) or `Google`
- **Model**: For Deepgram, choose `Nova 2` or `Nova 3`; for Google, choose `Latest`
- **Language**: Set to `Multi` (Deepgram) or `Multilingual` (Google)
4. **Other providers**: Single language only, no automatic detection
- **Provider**: Select `Deepgram` (recommended), `Google`, or `Gladia`
- **Model**: For Deepgram, choose `Nova 2` or `Nova 3`; for Google, choose `Latest`; for Gladia, choose your preferred Gladia model
- **Language / Mode**: Set `Multi` (Deepgram), `Multilingual` (Google), or enable automatic language detection (Gladia)
4. **Other providers**: May require a single language and not auto-detect
5. Click **Save** to apply the configuration
</Tab>
<Tab title="TypeScript (Server SDK)">
Expand Down Expand Up @@ -114,7 +114,7 @@ Set up your transcriber to automatically detect and process multiple languages.
</Tabs>

<Note>
**Provider Performance:** **Deepgram** offers the best balance of speed and multilingual accuracy. **Google** provides broader language support but may be slower. Both providers support automatic language detection within conversations.
**Provider Performance:** **Deepgram** offers the best balance of speed and multilingual accuracy. **Google** provides broader language support but may be slower. **Gladia** offers excellent automatic language recognition and code-switching with strong accuracy reported by customers. All three support automatic language detection within conversations.
</Note>

## Set up multilingual voices
Expand Down Expand Up @@ -463,7 +463,7 @@ Validate your configuration with different languages and scenarios.
| **Assembly AI** | ❌ English only | English | No multilingual support |
| **Azure STT** | ❌ Single language | 100+ | Many languages, but no auto-detection |
| **OpenAI Whisper** | ❌ Single language | 90+ | Many languages, but no auto-detection |
| **Gladia** | ❌ Single language | 80+ | Many languages, but no auto-detection |
| **Gladia** | ✅ Full auto-detection | 90+ | Supports automatic language detection and code-switching |
| **Speechmatics** | ❌ Single language | 50+ | Many languages, but no auto-detection |
| **Talkscriber** | ❌ Single language | 40+ | Many languages, but no auto-detection |

Expand All @@ -481,7 +481,7 @@ Validate your configuration with different languages and scenarios.
<AccordionGroup>
<Accordion title="Language detection is inaccurate">
**Solutions:**
- Use Deepgram (Nova 2/Nova 3 with "Multi") or Google STT (with "Multilingual")
- Use Deepgram (Nova 2/Nova 3 with "Multi"), Google STT (with "Multilingual"), or Gladia (automatic language detection)
- Ensure high-quality audio input for better detection accuracy
- Test with native speakers of target languages
- Consider provider-specific language combinations for optimal results
Expand Down
7 changes: 4 additions & 3 deletions fern/providers/transcriber/gladia.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -21,7 +21,7 @@ Gladia provides a comprehensive suite of AI-driven tools:

**Speech-to-Text:**

Gladia’s core offering is its AI-powered speech-to-text technology, delivering highly accurate and real-time transcription. This service supports 99 languages and includes speaker diarization and code-switching.
Gladia’s core offering is its AI-powered speech-to-text technology, delivering highly accurate and real-time transcription. This service supports automatic language detection (including code‑switching within a conversation) and 90+ languages, and includes speaker diarization.

**Audio Intelligence:**

Expand Down Expand Up @@ -54,8 +54,9 @@ Gladia excels in providing real-time transcription and translation:

**Multilingual Support:**

- 99 Languages: Supports a wide range of languages and dialects.
- Real-time Translation: Near-instantaneous translation for diverse applications.
- Automatic language recognition: Detects the spoken language automatically and handles code‑switching
- 90+ languages: Supports a wide range of languages and dialects
- Real-time Translation: Near-instantaneous translation for diverse applications

**Use Cases:**

Expand Down
Loading