Skip to content

Commit 1fde8de

Browse files
committed
Mistral Large 2407 and Mistral Nemo updates
1 parent 642f9c7 commit 1fde8de

File tree

1 file changed

+32
-6
lines changed

1 file changed

+32
-6
lines changed

articles/ai-studio/how-to/deploy-models-mistral.md

Lines changed: 32 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -20,7 +20,7 @@ ms.custom: references_regions, build-2024
2020
In this article, you learn how to use Azure AI Studio to deploy the Mistral family of models as serverless APIs with pay-as-you-go token-based billing.
2121
Mistral AI offers two categories of models in the [Azure AI Studio](https://ai.azure.com). These models are available in the [model catalog](model-catalog-overview.md):
2222

23-
* __Premium models__: Mistral Large and Mistral Small. These models can be deployed as serverless APIs with pay-as-you-go token-based billing.
23+
* __Premium models__: Mistral Large, Mistral Large 2407, Mistral Small, and Mistral Nemo. These models can be deployed as serverless APIs with pay-as-you-go token-based billing.
2424
* __Open models__: Mixtral-8x7B-Instruct-v01, Mixtral-8x7B-v01, Mistral-7B-Instruct-v01, and Mistral-7B-v01. These models can be deployed to managed computes in your own Azure subscription.
2525

2626
You can browse the Mistral family of models in the model catalog by filtering on the Mistral collection.
@@ -29,34 +29,60 @@ You can browse the Mistral family of models in the model catalog by filtering on
2929

3030
# [Mistral Large](#tab/mistral-large)
3131

32-
Mistral Large is Mistral AI's most advanced Large Language Model (LLM). It can be used on any language-based task, thanks to its state-of-the-art reasoning and knowledge capabilities.
32+
Mistral Large is Mistral AI's most advanced Large Language Model (LLM). It can be used on any language-based task, thanks to its state-of-the-art reasoning and knowledge capabilities. There are two variants available for the Mistral Large model version:
3333

34-
Additionally, Mistral Large is:
34+
- Mistral Large
35+
- Mistral Large 2407
36+
37+
Additionally, some attributes of _Mistral Large_ include:
3538

3639
* __Specialized in RAG.__ Crucial information isn't lost in the middle of long context windows (up to 32-K tokens).
3740
* __Strong in coding.__ Code generation, review, and comments. Supports all mainstream coding languages.
3841
* __Multi-lingual by design.__ Best-in-class performance in French, German, Spanish, Italian, and English. Dozens of other languages are supported.
3942
* __Responsible AI compliant.__ Efficient guardrails baked in the model and extra safety layer with the `safe_mode` option.
4043

44+
And attributes of _Mistral Large 2407_ include:
45+
46+
- **Finetunable.** The model is finetunable as-a-service in Azure AI Studio.
47+
- **Multi-lingual by design.** Supports dozens of languages, including English, French, German, Spanish, and Italian.
48+
- **Proficient in coding.** Trained on more than 80 coding languages, including Python, Java, C, C++, JavaScript, and Bash. Also trained on more specific languages such as Swift and Fortran.
49+
- **Agent-centric.** Possesses agentic capabilities with native function calling and JSON outputting.
50+
- **Advanced in reasoning.** Demonstrates state-of-the-art mathematical and reasoning capabilities.
51+
52+
4153
# [Mistral Small](#tab/mistral-small)
4254

4355
Mistral Small is Mistral AI's most efficient Large Language Model (LLM). It can be used on any language-based task that requires high efficiency and low latency.
4456

4557
Mistral Small is:
4658

47-
- **A small model optimized for low latency.** Very efficient for high volume and low latency workloads. Mistral Small is Mistral's smallest proprietary model, it outperforms Mixtral-8x7B and has lower latency.
59+
- **A small model optimized for low latency.** Efficient for high volume and low latency workloads. Mistral Small is Mistral's smallest proprietary model, it outperforms Mixtral-8x7B and has lower latency.
4860
- **Specialized in RAG.** Crucial information isn't lost in the middle of long context windows (up to 32K tokens).
4961
- **Strong in coding.** Code generation, review, and comments. Supports all mainstream coding languages.
5062
- **Multi-lingual by design.** Best-in-class performance in French, German, Spanish, Italian, and English. Dozens of other languages are supported.
5163
- **Responsible AI compliant.** Efficient guardrails baked in the model, and extra safety layer with the `safe_mode` option.
5264

65+
66+
# [Mistral Nemo](#tab/mistral-nemo)
67+
68+
Mistral Nemo is a cutting-edge Language Model (LLM) boasting state-of-the-art reasoning, world knowledge, and coding capabilities within its size category.
69+
70+
Mistral Nemo is a 12B model, making it a powerful drop-in replacement for any system using Mistral 7B, which it supersedes. It supports a context length of 128K, and it accepts only text inputs and generates text outputs.
71+
72+
Additionally, Mistral Nemo is:
73+
74+
- **Jointly developed with Nvidia.** This collaboration has resulted in a powerful 12B model that pushes the boundaries of language understanding and generation.
75+
- **Multilingual proficient.** Mistral Nemo is equipped with a tokenizer called Tekken, which is designed for multilingual applications. It supports over 100 languages, such as English, French, German, and Spanish. Tekken is more efficient than the Llama 3 tokenizer in compressing text for approximately 85% of all languages, with significant improvements in Malayalam, Hindi, Arabic, and prevalent European languages.
76+
- **Agent-centric.** Mistral Nemo possesses top-tier agentic capabilities, including native function calling and JSON outputting.
77+
- **Advanced in reasoning.** Mistral Nemo demonstrates state-of-the-art mathematical and reasoning capabilities within its size category.
78+
5379
---
5480

5581
## Deploy Mistral family of models as a serverless API
5682

5783
Certain models in the model catalog can be deployed as a serverless API with pay-as-you-go billing. This kind of deployment provides a way to consume models as an API without hosting them on your subscription, while keeping the enterprise security and compliance that organizations need. This deployment option doesn't require quota from your subscription.
5884

59-
**Mistral Large** and **Mistral Small** can be deployed as a serverless API with pay-as-you-go billing and are offered by Mistral AI through the Microsoft Azure Marketplace. Mistral AI can change or update the terms of use and pricing of these models.
85+
**Mistral Large**, **Mistral Large 2407**, **Mistral Small**, and **Mistral Nemo** can be deployed as a serverless API with pay-as-you-go billing and are offered by Mistral AI through the Microsoft Azure Marketplace. Mistral AI can change or update the terms of use and pricing of these models.
6086

6187
### Prerequisites
6288

@@ -78,7 +104,7 @@ Certain models in the model catalog can be deployed as a serverless API with pay
78104

79105
### Create a new deployment
80106

81-
The following steps demonstrate the deployment of Mistral Large, but you can use the same steps to deploy Mistral Small by replacing the model name.
107+
The following steps demonstrate the deployment of Mistral Large, but you can use the same steps to deploy any of the premium Mistral models by replacing the model name.
82108

83109
To create a deployment:
84110

0 commit comments

Comments
 (0)