@@ -14,22 +14,23 @@ Our API supports the most popular models for [Chat](/generative-apis/how-to/quer
1414| Provider | Model string | Context window (Tokens) | Maximum output (Tokens)| License | Model card |
1515| -----------------| -----------------| -----------------| -----------------| -----------------| -----------------|
1616| Google (Preview) | ` gemma-3-27b-it ` | 40k | 8192 | [ Gemma] ( https://ai.google.dev/gemma/terms ) | [ HF] ( https://huggingface.co/google/gemma-3-27b-it ) |
17- | Mistral | ` mistral-small-3.1 -24b-instruct-2503 ` | 128k | 8192 | [ Apache-2.0] ( https://www.apache.org/licenses/LICENSE-2.0 ) | [ HF] ( https://huggingface.co/mistralai/Mistral-Small-3.1 -24B-Instruct-2503 ) |
17+ | Mistral | ` mistral-small-3.2 -24b-instruct-2506 ` | 128k | 8192 | [ Apache-2.0] ( https://www.apache.org/licenses/LICENSE-2.0 ) | [ HF] ( https://huggingface.co/mistralai/Mistral-Small-3.2 -24B-Instruct-2506 ) |
1818
1919## Chat models
2020
2121| Provider | Model string | Context window (Tokens) | Maximum output (Tokens)| License | Model card |
2222| -----------------| -----------------| -----------------| -----------------| -----------------| -----------------|
23+ | OpenAI | ` gpt-oss-120b ` | 128k | 8192 | [ Apache-2.0] ( https://www.apache.org/licenses/LICENSE-2.0 ) | [ HF] ( https://huggingface.co/openai/gpt-oss-120b ) |
2324| Mistral | ` devstral-small-2505 ` | 128k | 8192 | [ Apache-2.0] ( https://www.apache.org/licenses/LICENSE-2.0 ) | [ HF] ( https://huggingface.co/mistralai/Devstral-Small-2505 ) |
2425| Meta | ` llama-3.3-70b-instruct ` | 100k | 4096 | [ Llama 3.3 Community] ( https://www.llama.com/llama3_3/license/ ) | [ HF] ( https://huggingface.co/meta-llama/Llama-3.3-70B-Instruct ) |
2526| Meta | ` llama-3.1-8b-instruct ` | 128k | 16384 | [ Llama 3.1 Community] ( https://llama.meta.com/llama3_1/license/ ) | [ HF] ( https://huggingface.co/meta-llama/Llama-3.1-8B-Instruct ) |
2627| Mistral | ` mistral-nemo-instruct-2407 ` | 128k | 8192 | [ Apache-2.0] ( https://www.apache.org/licenses/LICENSE-2.0 ) | [ HF] ( https://huggingface.co/mistralai/Mistral-Nemo-Instruct-2407 ) |
2728| Qwen | ` qwen3-235b-a22b-instruct-2507 ` | 40k | 4096 | [ Apache-2.0] ( https://www.apache.org/licenses/LICENSE-2.0 ) | [ HF] ( https://huggingface.co/Qwen/Qwen3-235B-A22B-Instruct-2507 ) |
28- | Qwen | ` qwen2.5 -coder-32b- instruct` | 32k | 8192 | [ Apache-2.0] ( https://www.apache.org/licenses/LICENSE-2.0 ) | [ HF] ( https://huggingface.co/Qwen/Qwen2.5 -Coder-32B -Instruct ) |
29+ | Qwen | ` qwen3 -coder-30b-a3b- instruct` | 128k | 8192 | [ Apache-2.0] ( https://www.apache.org/licenses/LICENSE-2.0 ) | [ HF] ( https://huggingface.co/Qwen/Qwen3 -Coder-30B-A3B -Instruct ) |
2930| DeepSeek | ` deepseek-r1-distill-llama-70b ` | 32k | 4096 | [ MIT] ( https://huggingface.co/datasets/choosealicense/licenses/blob/main/markdown/mit.md ) | [ HF] ( https://huggingface.co/deepseek-ai/DeepSeek-R1-Distill-Llama-70B ) |
3031
3132<Message type = " tip" >
32- If you are unsure which chat model to use, we currently recommend Mistral Small 3.1 24B Instruct (` mistral-small-3.1 -24b-instruct-2503 ` ) to get started.
33+ If you are unsure which chat model to use, we currently recommend Mistral Small 3.2 24B Instruct (` mistral-small-3.2 -24b-instruct-2506 ` ) to get started.
3334</Message >
3435
3536## Vision models
@@ -61,7 +62,8 @@ Deprecated models should not be queried anymore. We recommend to use newer model
6162
6263| Provider | Model string | End of Life (EOL) date
6364| -----------------| -----------------| -----------------|
64- | Meta | ` llama-3.1-70b-instruct ` | 25th May, 2025 |
65+ | Mistral | ` mistral-small-3.1-24b-instruct-2503 ` | 14th November, 2025 |
66+ | Qwen | ` qwen2.5-coder-32b-instruct ` | 14th November, 2025 |
6567
6668<Message type = " note" >
6769 Llama 3.1 70B is now deprecated. The new Llama 3.3 70B is available with similar or better performance in most use cases.
@@ -74,4 +76,5 @@ These models are not accessible anymore from Generative APIs. They can still how
7476
7577| Provider | Model string | EOL date
7678| -----------------| -----------------| -----------------|
79+ | Meta | ` llama-3.1-70b-instruct ` | 25th May, 2025 |
7780| SBERT | ` sentence-t5-xxl ` | 26 February, 2025 |
0 commit comments