You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/ai-studio/includes/region-availability-maas.md
+1-1Lines changed: 1 addition & 1 deletion
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -60,7 +60,7 @@ Phi-3-Medium-4K-Instruct <br> Phi-3-Medium-128K-Instruct | Not applicable | E
60
60
Mistral Nemo | [Microsoft Managed Countries](/partner-center/marketplace/tax-details-marketplace#microsoft-managed-countriesregions) <br> Brazil <br> Hong Kong <br> Israel | East US <br> East US 2 <br> North Central US <br> South Central US <br> Sweden Central <br> West US <br> West US 3 | Not available |
61
61
Ministral-3B | [Microsoft Managed Countries](/partner-center/marketplace/tax-details-marketplace#microsoft-managed-countriesregions) <br> Brazil <br> Hong Kong <br> Israel | East US <br> East US 2 <br> North Central US <br> South Central US <br> Sweden Central <br> West US <br> West US 3 | Not available |
62
62
Mistral Small | [Microsoft Managed Countries](/partner-center/marketplace/tax-details-marketplace#microsoft-managed-countriesregions) <br> Brazil <br> Hong Kong <br> Israel | East US <br> East US 2 <br> North Central US <br> South Central US <br> Sweden Central <br> West US <br> West US 3 | Not available |
63
-
Mistral Large (2402) <br> Mistral-Large (2407) <br> Mistral-Large (2411) | [Microsoft Managed Countries](/partner-center/marketplace/tax-details-marketplace#microsoft-managed-countriesregions) <br> Brazil <br> Hong Kong <br> Israel | East US <br> East US 2 <br> North Central US <br> South Central US <br> Sweden Central <br> West US <br> West US 3 | Not available |
63
+
Mistral Large <br> Mistral-Large (2407) <br> Mistral-Large (2411) | [Microsoft Managed Countries](/partner-center/marketplace/tax-details-marketplace#microsoft-managed-countriesregions) <br> Brazil <br> Hong Kong <br> Israel | East US <br> East US 2 <br> North Central US <br> South Central US <br> Sweden Central <br> West US <br> West US 3 | Not available |
Copy file name to clipboardExpand all lines: articles/machine-learning/how-to-deploy-models-mistral.md
+24-17Lines changed: 24 additions & 17 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -20,7 +20,7 @@ In this article, you learn how to use Azure Machine Learning studio to deploy th
20
20
21
21
Mistral AI offers two categories of models in Azure Machine Learning studio. These models are available in the [model catalog](concept-model-catalog.md).
22
22
23
-
*__Premium models__: Mistral Large (2402), Mistral Large (2407), Mistral Small, and Ministral-3B.
23
+
*__Premium models__: Mistral Large (2402), Mistral Large (2407), Mistral Large (2411), Mistral Small, and Ministral-3B.
24
24
*__Open models__: Mistral Nemo, Mixtral-8x7B-Instruct-v01, Mixtral-8x7B-v01, Mistral-7B-Instruct-v01, and Mistral-7B-v01.
25
25
26
26
All the premium models and Mistral Nemo (an open model) can be deployed as serverless APIs with pay-as-you-go token-based billing. The other open models can be deployed to managed computes in your own Azure subscription.
@@ -31,24 +31,31 @@ You can browse the Mistral family of models in the model catalog by filtering on
31
31
32
32
# [Mistral Large](#tab/mistral-large)
33
33
34
-
Mistral Large is Mistral AI's most advanced Large Language Model (LLM). It can be used on any language-based task, thanks to its state-of-the-art reasoningand knowledge capabilities. There are two variants available for the Mistral Large model version:
34
+
Mistral Large models are Mistral AI's most advanced Large Language Models (LLM). They can be used on any language-based task, thanks to their state-of-the-art reasoning, knowledge, and coding capabilities. Several Mistral Large model variants are available:
35
35
36
-
- Mistral Large (2402)
36
+
- Mistral Large (2402), also abbreviated as Mistral Large
37
37
- Mistral Large (2407)
38
+
- Mistral Large (2411)
38
39
39
-
Additionally, some attributes of _Mistral Large (2402)_ include:
40
+
Attributes of **Mistral Large (2402)**, also abbreviated as **Mistral Large**, include:
40
41
41
-
-__Specialized in RAG.__ Crucial information isn't lost in the middle of long context windows (up to 32K tokens).
42
-
-__Strong in coding.__ Code generation, review, and comments. Supports all mainstream coding languages.
43
-
-__Multi-lingual by design.__ Best-in-class performance in French, German, Spanish, and Italian - in addition to English. Dozens of other languages are supported.
44
-
-__Responsible AI compliant.__ Efficient guardrails baked in the model, and extra safety layer with the `safe_mode` option.
42
+
***Specialized in RAG**. Crucial information isn't lost in the middle of long context windows (up to 32-K tokens).
43
+
***Strong in coding**. Code generation, review, and comments. Supports all mainstream coding languages.
44
+
***Multi-lingual by design**. Best-in-class performance in French, German, Spanish, Italian, and English. Dozens of other languages are supported.
45
+
***Responsible AI compliant**. Efficient guardrails baked in the model and extra safety layer with the safe_mode option.
45
46
46
-
And attributes of _Mistral Large (2407)_ include:
47
+
Attributes of **Mistral Large (2407)** include:
48
+
49
+
***Multi-lingual by design**. Supports dozens of languages, including English, French, German, Spanish, and Italian.
50
+
***Proficient in coding**. Trained on more than 80 coding languages, including Python, Java, C, C++, JavaScript, and Bash. Also trained on more specific languages such as Swift and Fortran.
51
+
***Agent-centric**. Possesses agentic capabilities with native function calling and JSON outputting.
52
+
***Advanced in reasoning**. Demonstrates state-of-the-art mathematical and reasoning capabilities.
53
+
54
+
Attributes of **Mistral Large (2411)** include the same as Mistral Large (2407) with the following additional attributes:
55
+
* System prompts are injected before each conversation.
56
+
* Better performance on long content.
57
+
* Improved function calling capabilities.
47
58
48
-
-**Multi-lingual by design.** Supports dozens of languages, including English, French, German, Spanish, and Italian.
49
-
-**Proficient in coding.** Trained on more than 80 coding languages, including Python, Java, C, C++, JavaScript, and Bash. Also trained on more specific languages such as Swift and Fortran.
50
-
-**Agent-centric.** Possesses agentic capabilities with native function calling and JSON outputting.
51
-
-**Advanced in reasoning.** Demonstrates state-of-the-art mathematical and reasoning capabilities.
52
59
53
60
54
61
# [Mistral Small](#tab/mistral-small)
@@ -96,7 +103,7 @@ Additionally, Mistral Nemo is:
96
103
97
104
Certain models in the model catalog can be deployed as a serverless API with pay-as-you-go billing. This kind of deployment provides a way to consume models as an API without hosting them on your subscription, while keeping the enterprise security and compliance that organizations need. This deployment option doesn't require quota from your subscription.
98
105
99
-
**Mistral Large (2402)**, **Mistral Large (2407)**, **Mistral Small**, and **Mistral Nemo** can be deployed as a serverless API with pay-as-you-go billing and are offered by Mistral AI through the Microsoft Azure Marketplace. Mistral AI can change or update the terms of use and pricing of these models.
106
+
**Mistral Large**, **Mistral Large (2407)**, **Mistral Large (2411)**, **Mistral Small**, and **Mistral Nemo** can be deployed as a serverless API with pay-as-you-go billing and are offered by Mistral AI through the Microsoft Azure Marketplace. Mistral AI can change or update the terms of use and pricing of these models.
100
107
101
108
102
109
### Prerequisites
@@ -118,13 +125,13 @@ Certain models in the model catalog can be deployed as a serverless API with pay
118
125
119
126
### Create a new deployment
120
127
121
-
The following steps demonstrate the deployment of Mistral Large (2402), but you can use the same steps to deploy Mistral Nemo or any of the premium Mistral models by replacing the model name.
128
+
The following steps demonstrate the deployment of Mistral Large, but you can use the same steps to deploy Mistral Nemo or any of the premium Mistral models by replacing the model name.
122
129
123
130
To create a deployment:
124
131
125
132
1. Go to [Azure Machine Learning studio](https://ml.azure.com/home).
126
133
1. Select the workspace in which you want to deploy your model. To use the serverless API model deployment offering, your workspace must belong to one of the regions listed in the [prerequisites](#prerequisites).
127
-
1. Choose the model you want to deploy, for example the Mistral Large (2402) model, from the [model catalog](https://ml.azure.com/model/catalog).
134
+
1. Choose the model you want to deploy, for example the Mistral Large model, from the [model catalog](https://ml.azure.com/model/catalog).
128
135
129
136
Alternatively, you can initiate deployment by going to your workspace and selecting **Endpoints** > **Serverless endpoints** > **Create**.
130
137
@@ -135,7 +142,7 @@ To create a deployment:
135
142
136
143
1. In the deployment wizard, select the link to **Azure Marketplace Terms** to learn more about the terms of use.
137
144
1. You can also select the **Pricing and terms** tab to learn about pricing for the selected model.
138
-
1. If this is your first time deploying the model in the workspace, you have to subscribe your workspace for the particular offering (for example, Mistral Large (2402)). This step requires that your account has the **Azure AI Developer role** permissions on the Resource Group, as listed in the prerequisites. Each workspace has its own subscription to the particular Azure Marketplace offering, which allows you to control and monitor spending. Select **Subscribe and Deploy**. Currently you can have only one deployment for each model within a workspace.
145
+
1. If this is your first time deploying the model in the workspace, you have to subscribe your workspace for the particular offering (for example, Mistral Large). This step requires that your account has the **Azure AI Developer role** permissions on the Resource Group, as listed in the prerequisites. Each workspace has its own subscription to the particular Azure Marketplace offering, which allows you to control and monitor spending. Select **Subscribe and Deploy**. Currently you can have only one deployment for each model within a workspace.
139
146
140
147
1. Once you subscribe the workspace for the particular Azure Marketplace offering, subsequent deployments of the _same_ offering in the _same_ workspace don't require subscribing again. If this scenario applies to you, you'll see a **Continue to deploy** option to select.
0 commit comments