You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
# How to deploy Mistral models with Azure Machine Learning studio
19
19
Mistral AI offers two categories of models in Azure Machine Learning studio:
20
20
21
-
- Premium models: Mistral-large. These models are available with pay-as-you-go token based billing with Models as a Service in the studio model catalog.
21
+
- Premium models: Mistral Large. These models are available with pay-as-you-go token based billing with Models as a Service in the studio model catalog.
22
22
- Open models: Mixtral-8x7B-Instruct-v01, Mixtral-8x7B-v01, Mistral-7B-Instruct-v01, and Mistral-7B-v01. These models are also available in the Azure Machine Learning studio model catalog and can be deployed to dedicated VM instances in your own Azure subscription with managed online endpoints.
23
23
24
24
You can browse the Mistral family of models in the model catalog by filtering on the Mistral collection.
25
25
26
-
## Mistral-large
26
+
## Mistral Large
27
27
28
-
In this article, you learn how to use Azure Machine Learning studio to deploy the Mistral-large model as a service with pay-as you go billing.
28
+
In this article, you learn how to use Azure Machine Learning studio to deploy the Mistral Large model as a service with pay-as you go billing.
29
29
30
-
Mistral-large is Mistral AI's most advanced Large Language Model (LLM). It can be used on any language-based task thanks to its state-of-the-art reasoning and knowledge capabilities.
30
+
Mistral Large is Mistral AI's most advanced Large Language Model (LLM). It can be used on any language-based task thanks to its state-of-the-art reasoning and knowledge capabilities.
31
31
32
32
Additionally, mistral-large is:
33
33
@@ -38,17 +38,17 @@ Additionally, mistral-large is:
Certain models in the model catalog can be deployed as a service with pay-as-you-go, providing a way to consume them as an API without hosting them on your subscription, while keeping the enterprise security and compliance organizations need. This deployment option doesn't require quota from your subscription.
44
44
45
-
Mistral-large can be deployed as a service with pay-as-you-go, and is offered by Mistral AI through the Microsoft Azure Marketplace. Please note that Mistral AI can change or update the terms of use and pricing of this model.
45
+
Mistral Large can be deployed as a service with pay-as-you-go, and is offered by Mistral AI through the Microsoft Azure Marketplace. Please note that Mistral AI can change or update the terms of use and pricing of this model.
46
46
47
47
### Azure Marketplace model offerings
48
48
49
49
The following models are available in Azure Marketplace for Mistral AI when deployed as a service with pay-as-you-go:
50
50
51
-
* Mistral-large (preview)
51
+
* Mistral Large (preview)
52
52
53
53
### Prerequisites
54
54
@@ -98,9 +98,9 @@ To create a deployment:
98
98
99
99
To learn about billing for Mistral models deployed with pay-as-you-go, see [Cost and quota considerations for Mistral models deployed as a service](#cost-and-quota-considerations-for-mistral-large-deployed-as-a-service).
100
100
101
-
### Consume the Mistral-large model as a service
101
+
### Consume the Mistral Large model as a service
102
102
103
-
Mistral-large can be consumed using the chat API.
103
+
Mistral Large can be consumed using the chat API.
104
104
105
105
1. In the **workspace**, select **Endpoints** > **Serverless endpoints**.
106
106
1. Find and select the deployment you created.
@@ -252,7 +252,7 @@ The following is an example response:
252
252
253
253
## Cost and quotas
254
254
255
-
### Cost and quota considerations for Mistral-large deployed as a service
255
+
### Cost and quota considerations for Mistral Large deployed as a service
256
256
257
257
Mistral models deployed as a service are offered by Mistral AI through Azure Marketplace and integrated with Azure Machine Learning studio for use. You can find Azure Marketplace pricing when deploying the models.
0 commit comments