You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: fern/customization/multilingual.mdx
+44-46Lines changed: 44 additions & 46 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -15,9 +15,9 @@ Configure your voice assistant to communicate in multiple languages with automat
15
15
- Design language-aware system prompts
16
16
- Test and optimize multilingual performance
17
17
18
-
<Warning>
19
-
**Provider Limitations:**Most transcription providers don't support true multilingual mode. Only **Google STT**currently supports automatic language detection and switching within a single conversation.
20
-
</Warning>
18
+
<Note>
19
+
**Multilingual Support:**Multiple providers support automatic language detection. **Deepgram** (Nova 2, Nova 3 with "Multi" setting) and **Google STT**(with "Multilingual" setting) both offer automatic language detection for seamless multilingual conversations.
20
+
</Note>
21
21
22
22
## Configure automatic language detection
23
23
@@ -28,12 +28,10 @@ Set up your transcriber to automatically detect and process multiple languages.
28
28
1. Navigate to **Assistants** in your [Vapi Dashboard](https://dashboard.vapi.ai/)
29
29
2. Create a new assistant or edit an existing one
30
30
3. In the **Transcriber** section:
31
-
-**Provider**: Select `Google` (only provider with true multilingual support)
32
-
-**Model**: Choose Flash or Flash Lite (recommended for speed)
33
-
-**Language Detection**: Set to `Automatic multiple languages`
34
-
4.**Alternative for limited multilingual**:
35
-
-**Deepgram**: Only supports English and Spanish in "Multi" mode
36
-
-**Other providers**: Single language only, no auto-detection
31
+
-**Provider**: Select `Deepgram` (recommended) or `Google`
32
+
-**Model**: For Deepgram, choose `Nova 2` or `Nova 3`; for Google, choose `Latest`
33
+
-**Language**: Set to `Multi` (Deepgram) or `Multilingual` (Google)
34
+
4.**Other providers**: Single language only, no automatic detection
37
35
5. Click **Save** to apply the configuration
38
36
</Tab>
39
37
<Tabtitle="TypeScript (Server SDK)">
@@ -42,21 +40,21 @@ Set up your transcriber to automatically detect and process multiple languages.
42
40
43
41
const vapi =newVapiClient({ token: "YOUR_VAPI_API_KEY" });
44
42
45
-
// Recommended: Google for true multilingual support
43
+
// Recommended: Deepgram for multilingual support
46
44
const assistant =awaitvapi.assistants.create({
47
45
name: "Multilingual Assistant",
48
46
transcriber: {
49
-
provider: "google",
50
-
model: "gemini-2.0-flash-lite", // or "gemini-2.0-flash" for better accuracy
51
-
languageBehaviour: "automatic multiple languages"
47
+
provider: "deepgram",
48
+
model: "nova-2", // or "nova-3"
49
+
language: "multi"
52
50
}
53
51
});
54
52
55
-
// Alternative: Deepgram for English + Spanish only
56
-
constlimitedMultilingual= {
57
-
provider: "deepgram",
58
-
model: "nova-2",
59
-
languageBehaviour: "Multi"// Only en + es supported
53
+
// Alternative: Google for multilingual support
54
+
constgoogleMultilingual= {
55
+
provider: "google",
56
+
model: "latest",
57
+
language: "multilingual"
60
58
};
61
59
```
62
60
</Tab>
@@ -67,56 +65,56 @@ Set up your transcriber to automatically detect and process multiple languages.
67
65
68
66
client = Vapi(token=os.getenv("VAPI_API_KEY"))
69
67
70
-
# Recommended: Google for true multilingual support
68
+
# Recommended: Deepgram for multilingual support
71
69
assistant = client.assistants.create(
72
70
name="Multilingual Assistant",
73
71
transcriber={
74
-
"provider": "google",
75
-
"model": "gemini-2.0-flash-lite", # or "gemini-2.0-flash" for better accuracy
# Alternative: Deepgram for English + Spanish only
101
+
# Alternative: Google for multilingual support
104
102
curl -X POST "https://api.vapi.ai/assistant" \
105
103
-H "Authorization: Bearer $VAPI_API_KEY" \
106
104
-H "Content-Type: application/json" \
107
105
-d '{
108
106
"transcriber": {
109
-
"provider": "deepgram",
110
-
"model": "nova-2",
111
-
"languageBehaviour": "Multi"
107
+
"provider": "google",
108
+
"model": "latest",
109
+
"language": "multilingual"
112
110
}
113
111
}'
114
112
```
115
113
</Tab>
116
114
</Tabs>
117
115
118
116
<Note>
119
-
**Google STT Performance:**While Google is slower than other providers, use the `gemini-2.0-flash-lite` or `gemini-2.0-flash` models for better speed. These lighter models provide the best balance of multilingual support and performance.
117
+
**Provider Performance:****Deepgram** offers the best balance of speed and multilingual accuracy. **Google** provides broader language support but may be slower. Both providers support automatic language detection within conversations.
120
118
</Note>
121
119
122
120
## Set up multilingual voices
@@ -460,8 +458,8 @@ Validate your configuration with different languages and scenarios.
460
458
461
459
| Provider | Multilingual Support | Languages | Notes |
Copy file name to clipboardExpand all lines: fern/providers/model/openai.mdx
+2-2Lines changed: 2 additions & 2 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -7,7 +7,7 @@ slug: providers/model/openai
7
7
8
8
**What is OpenAI?**
9
9
10
-
OpenAI is a leading artificial intelligence research and deployment company dedicated to ensuring that artificial general intelligence (AGI) benefits all of humanity. Founded with the mission to create safe and highly capable AI systems, OpenAI has made significant strides in AI research, producing groundbreaking models like GPT-4, DALL-E, and Codex. These innovations have not only advanced the field of AI but also transformed various industries by providing powerful tools for natural language processing, image generation, and programming assistance.
10
+
OpenAI is a leading artificial intelligence research and deployment company dedicated to ensuring that artificial general intelligence (AGI) benefits all of humanity. Founded with the mission to create safe and highly capable AI systems, OpenAI has made significant strides in AI research, producing groundbreaking models like GPT-4o, DALL-E, and Codex. These innovations have not only advanced the field of AI but also transformed various industries by providing powerful tools for natural language processing, image generation, and programming assistance.
11
11
12
12
**The Evolution of AI Research:**
13
13
@@ -19,7 +19,7 @@ OpenAI offers a range of AI-driven products and services designed to meet divers
19
19
20
20
**GPT Models:**
21
21
22
-
- OpenAI’s Generative Pre-trained Transformer (GPT) models, including the latest GPT-4, are state-of-the-art in natural language processing. These models can generate human-like text, answer questions, summarize information, and perform various language tasks with high accuracy. GPT-4, in particular, represents a significant leap in AI capabilities, offering improved coherence, context understanding, and creativity.
22
+
- OpenAI’s Generative Pre-trained Transformer (GPT) models, including the latest GPT-4o, are state-of-the-art in natural language processing. These models can generate human-like text, answer questions, summarize information, and perform various language tasks with high accuracy. GPT-4o, in particular, represents a significant leap in AI capabilities, offering improved coherence, context understanding, and creativity.
Copy file name to clipboardExpand all lines: fern/providers/voice/openai.mdx
+2-2Lines changed: 2 additions & 2 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -7,7 +7,7 @@ slug: providers/voice/openai
7
7
8
8
**What is OpenAI?**
9
9
10
-
OpenAI is a leading artificial intelligence research and deployment company dedicated to ensuring that artificial general intelligence (AGI) benefits all of humanity. Founded with the mission to create safe and highly capable AI systems, OpenAI has made significant strides in AI research, producing groundbreaking models like GPT-4, DALL-E, and Codex. These innovations have not only advanced the field of AI but also transformed various industries by providing powerful tools for natural language processing, image generation, and programming assistance.
10
+
OpenAI is a leading artificial intelligence research and deployment company dedicated to ensuring that artificial general intelligence (AGI) benefits all of humanity. Founded with the mission to create safe and highly capable AI systems, OpenAI has made significant strides in AI research, producing groundbreaking models like GPT-4o, DALL-E, and Codex. These innovations have not only advanced the field of AI but also transformed various industries by providing powerful tools for natural language processing, image generation, and programming assistance.
11
11
12
12
**The Evolution of AI Research:**
13
13
@@ -19,7 +19,7 @@ OpenAI offers a range of AI-driven products and services designed to meet divers
19
19
20
20
**GPT Models:**
21
21
22
-
- OpenAI’s Generative Pre-trained Transformer (GPT) models, including the latest GPT-4, are state-of-the-art in natural language processing. These models can generate human-like text, answer questions, summarize information, and perform various language tasks with high accuracy. GPT-4, in particular, represents a significant leap in AI capabilities, offering improved coherence, context understanding, and creativity.
22
+
- OpenAI’s Generative Pre-trained Transformer (GPT) models, including the latest GPT-4o, are state-of-the-art in natural language processing. These models can generate human-like text, answer questions, summarize information, and perform various language tasks with high accuracy. GPT-4o, in particular, represents a significant leap in AI capabilities, offering improved coherence, context understanding, and creativity.
P001,CloudSync Pro,CloudSync Pro,CloudSync Pro,cloud_storage,29.99,"Professional cloud storage with 1TB space and advanced sharing","Almacenamiento en la nube profesional con 1TB de espacio y compartición avanzada","Stockage cloud professionnel avec 1 To d'espace et partage avancé",available
3
+
P002,SecureVPN Enterprise,VPN Segura Empresarial,VPN Sécurisé Entreprise,security,49.99,"Enterprise-grade VPN with global servers and 24/7 support","VPN de nivel empresarial con servidores globales y soporte 24/7","VPN de niveau entreprise avec serveurs mondiaux et support 24h/24",available
4
+
P003,DataAnalytics Suite,Suite de Análisis de Datos,Suite d'Analyse de Données,analytics,99.99,"Complete data analytics platform with AI-powered insights","Plataforma completa de análisis de datos con insights impulsados por IA","Plateforme d'analyse de données complète avec des insights alimentés par l'IA",available
5
+
P004,Mobile App Builder,Constructor de Apps Móviles,Constructeur d'Apps Mobiles,development,79.99,"No-code mobile app development platform","Plataforma de desarrollo de aplicaciones móviles sin código","Plateforme de développement d'applications mobiles sans code",available
6
+
P005,Smart Backup Pro,Backup Inteligente Pro,Sauvegarde Intelligente Pro,backup,19.99,"Automated backup solution with intelligent scheduling","Solución de respaldo automatizada con programación inteligente","Solution de sauvegarde automatisée avec planification intelligente",available
7
+
P006,Team Collaboration Hub,Centro de Colaboración,Hub de Collaboration,collaboration,39.99,"All-in-one team collaboration platform","Plataforma de colaboración en equipo todo-en-uno","Plateforme de collaboration d'équipe tout-en-un",available
8
+
P007,AI Assistant Pro,Asistente IA Pro,Assistant IA Pro,ai,149.99,"Advanced AI assistant for business automation","Asistente de IA avanzado para automatización empresarial","Assistant IA avancé pour l'automatisation des entreprises",beta
9
+
P008,Network Monitor,Monitor de Red,Moniteur Réseau,monitoring,59.99,"Real-time network monitoring and alerting","Monitoreo de red en tiempo real y alertas","Surveillance réseau en temps réel et alertes",available
10
+
P009,Database Optimizer,Optimizador de Base de Datos,Optimiseur de Base de Données,database,89.99,"Database performance optimization tool","Herramienta de optimización de rendimiento de base de datos","Outil d'optimisation des performances de base de données",available
11
+
P010,Code Review Assistant,Asistente de Revisión de Código,Assistant de Révision de Code,development,69.99,"Automated code review with quality insights","Revisión automatizada de código con insights de calidad","Révision automatisée du code avec des insights qualité",coming_soon
0 commit comments