You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
# How to deploy Mistral models with Azure AI Studio
17
17
18
18
Mistral AI offers two categories of models in AI Studio:
19
-
* Premium models: Mistral-large. These models are available with pay-as-you-go token based billing with Models as a Service in the AI Studio model catalog.
19
+
* Premium models: Mistral Large. These models are available with pay-as-you-go token based billing with Models as a Service in the AI Studio model catalog.
20
20
* Open models: Mixtral-8x7B-Instruct-v01, Mixtral-8x7B-v01, Mistral-7B-Instruct-v01, and Mistral-7B-v01. These models are also available in the AI Studio model catalog and can be deployed to dedicated VM instances in your own Azure subscription with Managed Online Endpoints.
21
21
22
22
You can browse the Mistral family of models in the Model Catalog by filtering on the Mistral collection.
23
23
24
-
## Mistral-large
24
+
## Mistral Large
25
25
26
-
In this article, you learn how to use Azure AI Studio to deploy the Mistral-large model as a service with pay-as you go billing.
26
+
In this article, you learn how to use Azure AI Studio to deploy the Mistral Large model as a service with pay-as you go billing.
27
27
28
-
Mistral-large is Mistral AI's most advanced Large Language Model (LLM). It can be used on any language-based task thanks to its state-of-the-art reasoning and knowledge capabilities.
28
+
Mistral Large is Mistral AI's most advanced Large Language Model (LLM). It can be used on any language-based task thanks to its state-of-the-art reasoning and knowledge capabilities.
29
29
30
30
Additionally, mistral-large is:
31
31
@@ -36,11 +36,11 @@ Additionally, mistral-large is:
36
36
37
37
[!INCLUDE [Azure AI Studio preview](../includes/preview-ai-studio.md)]
38
38
39
-
## Deploy Mistral-large with pay-as-you-go
39
+
## Deploy Mistral Large with pay-as-you-go
40
40
41
41
Certain models in the model catalog can be deployed as a service with pay-as-you-go, providing a way to consume them as an API without hosting them on your subscription, while keeping the enterprise security and compliance organizations need. This deployment option doesn't require quota from your subscription.
42
42
43
-
Mistral-large can be deployed as a service with pay-as-you-go, and is offered by Mistral AI through the Microsoft Azure Marketplace. Note that Mistral AI can change or update the terms of use and pricing of this model.
43
+
Mistral Large can be deployed as a service with pay-as-you-go, and is offered by Mistral AI through the Microsoft Azure Marketplace. Note that Mistral AI can change or update the terms of use and pricing of this model.
44
44
45
45
### Prerequisites
46
46
@@ -89,11 +89,11 @@ To create a deployment:
89
89
1. You can return to the Deployments page, select the deployment, and note the endpoint's **Target** URL and the Secret **Key**, which you can use to call the deployment for chat completions using the [`<target_url>/v1/chat/completions`](#chat-api) API.
90
90
1. You can always find the endpoint's details, URL, and access keys by navigating to the **Build** tab and selecting **Deployments** from the Components section.
91
91
92
-
To learn about billing for the Mistral AI model deployed with pay-as-you-go, see [Cost and quota considerations for Mistral-large deployed as a service](#cost-and-quota-considerations-for-mistral-large-deployed-as-a-service).
92
+
To learn about billing for the Mistral AI model deployed with pay-as-you-go, see [Cost and quota considerations for Mistral Large deployed as a service](#cost-and-quota-considerations-for-mistral-large-deployed-as-a-service).
93
93
94
-
### Consume the Mistral-large model as a service
94
+
### Consume the Mistral Large model as a service
95
95
96
-
Mistral-large can be consumed using the chat API.
96
+
Mistral Large can be consumed using the chat API.
97
97
98
98
1. On the **Build** page, select **Deployments**.
99
99
@@ -105,7 +105,7 @@ Mistral-large can be consumed using the chat API.
105
105
106
106
For more information on using the APIs, see the [reference](#reference-for-mistral-large-deployed-as-a-service) section.
107
107
108
-
### Reference for Mistral-large deployed as a service
108
+
### Reference for Mistral Large deployed as a service
109
109
110
110
#### Chat API
111
111
@@ -247,7 +247,7 @@ The following is an example response:
247
247
248
248
## Cost and quotas
249
249
250
-
### Cost and quota considerations for Mistral-large deployed as a service
250
+
### Cost and quota considerations for Mistral Large deployed as a service
251
251
252
252
Mistral models deployed as a service are offered by Mistral AI through the Azure Marketplace and integrated with Azure AI Studio for use. You can find the Azure Marketplace pricing when deploying the model.
0 commit comments