You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/ai-studio/concepts/content-filtering.md
+2-2Lines changed: 2 additions & 2 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -22,7 +22,7 @@ Azure AI Studio includes a content filtering system that works alongside core mo
22
22
> [!IMPORTANT]
23
23
> The content filtering system isn't applied to prompts and completions processed by the Whisper model in Azure OpenAI Service. Learn more about the [Whisper model in Azure OpenAI](../../ai-services/openai/concepts/models.md#whisper-preview).
24
24
25
-
This system is powered by Azure AI Content Safety, and now works by running both the prompt and completion through an ensemble of classification models aimed at detecting and preventing the output of harmful content. The content filtering system detects and takes action on specific categories of potentially harmful content in both input prompts and output completions. Variations in API configurations and application design might affect completions and thus filtering behavior.
25
+
This system is powered by [Azure AI Content Safety](../../ai-services/content-safety/overview.md), and works by running both the prompt and completion through an ensemble of classification models aimed at detecting and preventing the output of harmful content. The content filtering system detects and takes action on specific categories of potentially harmful content in both input prompts and output completions. Variations in API configurations and application design might affect completions and thus filtering behavior.
26
26
27
27
The content filtering models have been trained and tested on the following languages: English, German, Japanese, Spanish, French, Italian, Portuguese, and Chinese. However, the service can work in many other languages, but the quality can vary. In all cases, you should do your own testing to ensure that it works for your application.
28
28
@@ -86,5 +86,5 @@ Now, you can go to the playground to test whether the content filter works as ex
86
86
## Next steps
87
87
88
88
- Learn more about the [underlying models that power Azure OpenAI](../../ai-services/openai/concepts/models.md).
89
-
- Azure AI Studio content filtering is powered by [Azure AI Content Safety](/azure/ai-services/content-safety/overview).
89
+
- Azure AI Studio content filtering is powered by [Azure AI Content Safety](../../ai-services/content-safety/overview.md).
90
90
- Learn more about understanding and mitigating risks associated with your application: [Overview of Responsible AI practices for Azure OpenAI models](/legal/cognitive-services/openai/overview?context=/azure/ai-services/context/context).
Copy file name to clipboardExpand all lines: articles/ai-studio/how-to/deploy-models-llama.md
+6-8Lines changed: 6 additions & 8 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -5,23 +5,21 @@ description: Learn how to deploy Llama 2 family of large language models with Az
5
5
manager: scottpolly
6
6
ms.service: azure-ai-studio
7
7
ms.topic: how-to
8
-
ms.date: 02/09/2024
8
+
ms.date: 3/6/2024
9
9
ms.reviewer: fasantia
10
10
ms.author: mopeakande
11
11
author: msakande
12
12
ms.custom: [references_regions]
13
-
14
-
#This functionality is also available in Azure Machine Learning: /azure/machine-learning/how-to-deploy-models-llama.md
15
13
---
16
14
17
15
# How to deploy Llama 2 family of large language models with Azure AI Studio
18
16
17
+
[!INCLUDE [Azure AI Studio preview](../includes/preview-ai-studio.md)]
18
+
19
19
In this article, you learn about the Llama 2 family of large language models (LLMs). You also learn how to use Azure AI Studio to deploy models from this set either as a service with pay-as you go billing or with hosted infrastructure in real-time endpoints.
20
20
21
21
The Llama 2 family of LLMs is a collection of pretrained and fine-tuned generative text models ranging in scale from 7 billion to 70 billion parameters. The model family also includes fine-tuned versions optimized for dialogue use cases with reinforcement learning from human feedback (RLHF), called Llama-2-chat.
22
22
23
-
[!INCLUDE [Azure AI Studio preview](../includes/preview-ai-studio.md)]
24
-
25
23
## Deploy Llama 2 models with pay-as-you-go
26
24
27
25
Certain models in the model catalog can be deployed as a service with pay-as-you-go, providing a way to consume them as an API without hosting them on your subscription, while keeping the enterprise security and compliance organizations need. This deployment option doesn't require quota from your subscription.
@@ -47,7 +45,7 @@ If you need to deploy a different model, [deploy it to real-time endpoints](#dep
47
45
- An [Azure AI hub resource](../how-to/create-azure-ai-resource.md).
48
46
49
47
> [!IMPORTANT]
50
-
> Pay-as-you-go model deployment offering is only available in AI hubs created in **East US 2** and **West US 3** regions.
48
+
> For Llama 2 family models, the pay-as-you-go model deployment offering is only available with AI hubs created in **East US 2** and **West US 3** regions.
51
49
52
50
- An [Azure AI project](../how-to/create-projects.md) in Azure AI Studio.
53
51
- Azure role-based access controls (Azure RBAC) are used to grant access to operations in Azure AI Studio. To perform the steps in this article, your user account must be assigned the __owner__ or __contributor__ role for the Azure subscription. Alternatively, your account can be assigned a custom role that has the following permissions:
@@ -77,9 +75,9 @@ To create a deployment:
77
75
1. Sign in to [Azure AI Studio](https://ai.azure.com).
78
76
1. Choose the model you want to deploy from the Azure AI Studio [model catalog](https://ai.azure.com/explore/models).
79
77
80
-
Alternatively, you can initiate deployment by starting from your project in AI Studio. From the **Build** tab of your project, select the **Deployments**option, then select**+ Create**.
78
+
Alternatively, you can initiate deployment by starting from your project in AI Studio. From the **Build** tab of your project, select **Deployments**>**+ Create**.
81
79
82
-
1. On the model's **Details** page, select **Deploy** and then **Pay-as-you-go**.
80
+
1. On the model's **Details** page, select **Deploy** and then select **Pay-as-you-go**.
83
81
84
82
:::image type="content" source="../media/deploy-monitor/llama/deploy-pay-as-you-go.png" alt-text="A screenshot showing how to deploy a model with the pay-as-you-go option." lightbox="../media/deploy-monitor/llama/deploy-pay-as-you-go.png":::
Copy file name to clipboardExpand all lines: articles/ai-studio/how-to/deploy-models-mistral.md
+20-21Lines changed: 20 additions & 21 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -5,53 +5,52 @@ description: Learn how to deploy Mistral Large with Azure AI Studio.
5
5
manager: scottpolly
6
6
ms.service: azure-ai-studio
7
7
ms.topic: how-to
8
-
ms.date: 02/23/2024
9
-
ms.reviewer: shubhiraj
10
-
reviewer: shubhirajMsft
8
+
ms.date: 3/6/2024
9
+
ms.reviewer: shubhirajMsft
11
10
ms.author: mopeakande
12
11
author: msakande
13
12
ms.custom: [references_regions]
14
-
15
13
---
14
+
16
15
# How to deploy Mistral models with Azure AI Studio
17
16
18
-
Mistral AI offers two categories of models in AI Studio:
17
+
[!INCLUDE [Azure AI Studio preview](../includes/preview-ai-studio.md)]
18
+
19
+
In this article, you learn how to use Azure AI Studio to deploy the Mistral Large model as a service with pay-as you go billing.
20
+
21
+
Mistral AI offers two categories of models in [Azure AI Studio](https://ai.azure.com):
19
22
* Premium models: Mistral Large. These models are available with pay-as-you-go token based billing with Models as a Service in the AI Studio model catalog.
20
23
* Open models: Mixtral-8x7B-Instruct-v01, Mixtral-8x7B-v01, Mistral-7B-Instruct-v01, and Mistral-7B-v01. These models are also available in the AI Studio model catalog and can be deployed to dedicated VM instances in your own Azure subscription with Managed Online Endpoints.
21
24
22
-
You can browse the Mistral family of models in the Model Catalog by filtering on the Mistral collection.
25
+
You can browse the Mistral family of models in the [Model Catalog](model-catalog.md) by filtering on the Mistral collection.
23
26
24
27
## Mistral Large
25
28
26
-
In this article, you learn how to use Azure AI Studio to deploy the Mistral Large model as a service with pay-as you go billing.
27
-
28
29
Mistral Large is Mistral AI's most advanced Large Language Model (LLM). It can be used on any language-based task thanks to its state-of-the-art reasoning and knowledge capabilities.
29
30
30
31
Additionally, mistral-large is:
31
32
32
-
* Specialized in RAG. Crucial information isn't lost in the middle of long context windows (up to 32K tokens).
33
+
* Specialized in RAG. Crucial information isn't lost in the middle of long context windows (up to 32-K tokens).
33
34
* Strong in coding. Code generation, review, and comments. Supports all mainstream coding languages.
34
35
* Multi-lingual by design. Best-in-class performance in French, German, Spanish, and Italian - in addition to English. Dozens of other languages are supported.
35
-
* Responsible AI. Efficient guardrails baked in the model, with additional safety layer with safe_mode option.
36
-
37
-
[!INCLUDE [Azure AI Studio preview](../includes/preview-ai-studio.md)]
36
+
* Responsible AI. Efficient guardrails baked in the model and another safety layer with the `safe_mode` option.
38
37
39
38
## Deploy Mistral Large with pay-as-you-go
40
39
41
40
Certain models in the model catalog can be deployed as a service with pay-as-you-go, providing a way to consume them as an API without hosting them on your subscription, while keeping the enterprise security and compliance organizations need. This deployment option doesn't require quota from your subscription.
42
41
43
-
Mistral Large can be deployed as a service with pay-as-you-go, and is offered by Mistral AI through the Microsoft Azure Marketplace. Note that Mistral AI can change or update the terms of use and pricing of this model.
42
+
Mistral Large can be deployed as a service with pay-as-you-go, and is offered by Mistral AI through the Microsoft Azure Marketplace. Mistral AI can change or update the terms of use and pricing of this model.
44
43
45
44
### Prerequisites
46
45
47
46
- An Azure subscription with a valid payment method. Free or trial Azure subscriptions won't work. If you don't have an Azure subscription, create a [paid Azure account](https://azure.microsoft.com/pricing/purchase-options/pay-as-you-go) to begin.
48
47
- An [Azure AI hub resource](../how-to/create-azure-ai-resource.md).
49
48
50
49
> [!IMPORTANT]
51
-
> Pay-as-you-go model deployment offering is only available in AI hubs created in **East US 2** and **France Central** regions.
50
+
> For Mistral family models, the pay-as-you-go model deployment offering is only available with AI hubs created in **East US 2** and **France Central** regions.
52
51
53
52
- An [Azure AI project](../how-to/create-projects.md) in Azure AI Studio.
54
-
- Azure role-based access controls (Azure RBAC) are used to grant access to operations in Azure AI Studio. To perform the steps in this article, your user account must be assigned the __Azure AI Developer role__ on the Resouce Group.
53
+
- Azure role-based access controls (Azure RBAC) are used to grant access to operations in Azure AI Studio. To perform the steps in this article, your user account must be assigned the __Azure AI Developer role__ on the resource group.
55
54
56
55
For more information on permissions, see [Role-based access control in Azure AI Studio](../concepts/rbac-ai-studio.md).
57
56
@@ -61,22 +60,22 @@ Mistral Large can be deployed as a service with pay-as-you-go, and is offered by
61
60
To create a deployment:
62
61
63
62
1. Sign in to [Azure AI Studio](https://ai.azure.com).
64
-
1.Go to the Azure AI Studio [model catalog](https://ai.azure.com/explore/models) under the **Explore** tab and search for Mistral-large.
63
+
1.Select **Model catalog** from the **Explore** tab and search for *Mistral-large*.
65
64
66
-
Alternatively, you can initiate a deployment by starting from your project in AI Studio. From the **Build** tab of your project, select the **Deployments**option, then select**+ Create**.
65
+
Alternatively, you can initiate a deployment by starting from your project in AI Studio. From the **Build** tab of your project, select **Deployments**>**+ Create**.
67
66
68
67
1. In the model catalog, on the model's **Details** page, select **Deploy** and then **Pay-as-you-go**.
69
68
70
69
:::image type="content" source="../media/deploy-monitor/mistral/mistral-deploy-pay-as-you-go.png" alt-text="A screenshot showing how to deploy a model with the pay-as-you-go option." lightbox="../media/deploy-monitor/mistral/mistral-deploy-pay-as-you-go.png":::
71
70
72
-
1. Select the project in which you want to deploy your model. To deploy the Mistral-large model your project must belong to the **East US 2** or **France Central** regions.
71
+
1. Select the project in which you want to deploy your model. To deploy the Mistral-large model your project must be in the **East US 2** or **France Central** regions.
73
72
1. In the deployment wizard, select the link to **Azure Marketplace Terms** to learn more about the terms of use.
74
73
1. You can also select the **Marketplace offer details** tab to learn about pricing for the selected model.
75
74
1. If this is your first time deploying the model in the project, you have to subscribe your project for the particular offering. This step requires that your account has the **Azure AI Developer role** permissions on the Resource Group, as listed in the prerequisites. Each project has its own subscription to the particular Azure Marketplace offering of the model, which allows you to control and monitor spending. Select **Subscribe and Deploy**. Currently you can have only one deployment for each model within a project.
76
75
77
76
:::image type="content" source="../media/deploy-monitor/mistral/mistral-deploy-marketplace-terms.png" alt-text="A screenshot showing the terms and conditions of a given model." lightbox="../media/deploy-monitor/mistral/mistral-deploy-marketplace-terms.png":::
78
77
79
-
1. Once you subscribe the project for the particular Azure Marketplace offering, subsequent deployments of the _same_ offering in the _same_ project don't require subscribing again. If this scenario applies to you, you will see a **Continue to deploy** option to select (Currently you can have only one deployment for each model within a project).
78
+
1. Once you subscribe the project for the particular Azure Marketplace offering, subsequent deployments of the _same_ offering in the _same_ project don't require subscribing again. If this scenario applies to you, you'll see a **Continue to deploy** option to select (Currently you can have only one deployment for each model within a project).
80
79
81
80
:::image type="content" source="../media/deploy-monitor/mistral/mistral-deploy-pay-as-you-go-project.png" alt-text="A screenshot showing a project that is already subscribed to the offering." lightbox="../media/deploy-monitor/mistral/mistral-deploy-pay-as-you-go-project.png":::
82
81
@@ -235,7 +234,7 @@ The following is an example response:
@@ -259,7 +258,7 @@ Quota is managed per deployment. Each deployment has a rate limit of 200,000 tok
259
258
260
259
## Content filtering
261
260
262
-
Models deployed as a service with pay-as-you-go are protected by Azure AI Content Safety. With Azure AI content safety, both the prompt and completion pass through an ensemble of classification models aimed at detecting and preventing the output of harmful content. The content filtering system detects and takes action on specific categories of potentially harmful content in both input prompts and output completions. Learn more about [Azure AI Content Safety](../concepts/content-filtering.md).
261
+
Models deployed as a service with pay-as-you-go are protected by [Azure AI Content Safety](../../ai-services/content-safety/overview.md). With Azure AI content safety, both the prompt and completion pass through an ensemble of classification models aimed at detecting and preventing the output of harmful content. The content filtering system detects and takes action on specific categories of potentially harmful content in both input prompts and output completions. Learn more about [content filtering here](../concepts/content-filtering.md).
0 commit comments