Skip to content

Commit e595457

Browse files
Merge pull request #268235 from eric-urban/eur/studio-refresh
mostly acrolinx and metadata
2 parents 52ade89 + ba7dfe2 commit e595457

File tree

3 files changed

+28
-31
lines changed

3 files changed

+28
-31
lines changed

articles/ai-studio/concepts/content-filtering.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -22,7 +22,7 @@ Azure AI Studio includes a content filtering system that works alongside core mo
2222
> [!IMPORTANT]
2323
> The content filtering system isn't applied to prompts and completions processed by the Whisper model in Azure OpenAI Service. Learn more about the [Whisper model in Azure OpenAI](../../ai-services/openai/concepts/models.md#whisper-preview).
2424
25-
This system is powered by Azure AI Content Safety, and now works by running both the prompt and completion through an ensemble of classification models aimed at detecting and preventing the output of harmful content. The content filtering system detects and takes action on specific categories of potentially harmful content in both input prompts and output completions. Variations in API configurations and application design might affect completions and thus filtering behavior.
25+
This system is powered by [Azure AI Content Safety](../../ai-services/content-safety/overview.md), and works by running both the prompt and completion through an ensemble of classification models aimed at detecting and preventing the output of harmful content. The content filtering system detects and takes action on specific categories of potentially harmful content in both input prompts and output completions. Variations in API configurations and application design might affect completions and thus filtering behavior.
2626

2727
The content filtering models have been trained and tested on the following languages: English, German, Japanese, Spanish, French, Italian, Portuguese, and Chinese. However, the service can work in many other languages, but the quality can vary. In all cases, you should do your own testing to ensure that it works for your application.
2828

@@ -86,5 +86,5 @@ Now, you can go to the playground to test whether the content filter works as ex
8686
## Next steps
8787

8888
- Learn more about the [underlying models that power Azure OpenAI](../../ai-services/openai/concepts/models.md).
89-
- Azure AI Studio content filtering is powered by [Azure AI Content Safety](/azure/ai-services/content-safety/overview).
89+
- Azure AI Studio content filtering is powered by [Azure AI Content Safety](../../ai-services/content-safety/overview.md).
9090
- Learn more about understanding and mitigating risks associated with your application: [Overview of Responsible AI practices for Azure OpenAI models](/legal/cognitive-services/openai/overview?context=/azure/ai-services/context/context).

articles/ai-studio/how-to/deploy-models-llama.md

Lines changed: 6 additions & 8 deletions
Original file line numberDiff line numberDiff line change
@@ -5,23 +5,21 @@ description: Learn how to deploy Llama 2 family of large language models with Az
55
manager: scottpolly
66
ms.service: azure-ai-studio
77
ms.topic: how-to
8-
ms.date: 02/09/2024
8+
ms.date: 3/6/2024
99
ms.reviewer: fasantia
1010
ms.author: mopeakande
1111
author: msakande
1212
ms.custom: [references_regions]
13-
14-
#This functionality is also available in Azure Machine Learning: /azure/machine-learning/how-to-deploy-models-llama.md
1513
---
1614

1715
# How to deploy Llama 2 family of large language models with Azure AI Studio
1816

17+
[!INCLUDE [Azure AI Studio preview](../includes/preview-ai-studio.md)]
18+
1919
In this article, you learn about the Llama 2 family of large language models (LLMs). You also learn how to use Azure AI Studio to deploy models from this set either as a service with pay-as you go billing or with hosted infrastructure in real-time endpoints.
2020

2121
The Llama 2 family of LLMs is a collection of pretrained and fine-tuned generative text models ranging in scale from 7 billion to 70 billion parameters. The model family also includes fine-tuned versions optimized for dialogue use cases with reinforcement learning from human feedback (RLHF), called Llama-2-chat.
2222

23-
[!INCLUDE [Azure AI Studio preview](../includes/preview-ai-studio.md)]
24-
2523
## Deploy Llama 2 models with pay-as-you-go
2624

2725
Certain models in the model catalog can be deployed as a service with pay-as-you-go, providing a way to consume them as an API without hosting them on your subscription, while keeping the enterprise security and compliance organizations need. This deployment option doesn't require quota from your subscription.
@@ -47,7 +45,7 @@ If you need to deploy a different model, [deploy it to real-time endpoints](#dep
4745
- An [Azure AI hub resource](../how-to/create-azure-ai-resource.md).
4846

4947
> [!IMPORTANT]
50-
> Pay-as-you-go model deployment offering is only available in AI hubs created in **East US 2** and **West US 3** regions.
48+
> For Llama 2 family models, the pay-as-you-go model deployment offering is only available with AI hubs created in **East US 2** and **West US 3** regions.
5149
5250
- An [Azure AI project](../how-to/create-projects.md) in Azure AI Studio.
5351
- Azure role-based access controls (Azure RBAC) are used to grant access to operations in Azure AI Studio. To perform the steps in this article, your user account must be assigned the __owner__ or __contributor__ role for the Azure subscription. Alternatively, your account can be assigned a custom role that has the following permissions:
@@ -77,9 +75,9 @@ To create a deployment:
7775
1. Sign in to [Azure AI Studio](https://ai.azure.com).
7876
1. Choose the model you want to deploy from the Azure AI Studio [model catalog](https://ai.azure.com/explore/models).
7977

80-
Alternatively, you can initiate deployment by starting from your project in AI Studio. From the **Build** tab of your project, select the **Deployments** option, then select **+ Create**.
78+
Alternatively, you can initiate deployment by starting from your project in AI Studio. From the **Build** tab of your project, select **Deployments** > **+ Create**.
8179

82-
1. On the model's **Details** page, select **Deploy** and then **Pay-as-you-go**.
80+
1. On the model's **Details** page, select **Deploy** and then select **Pay-as-you-go**.
8381

8482
:::image type="content" source="../media/deploy-monitor/llama/deploy-pay-as-you-go.png" alt-text="A screenshot showing how to deploy a model with the pay-as-you-go option." lightbox="../media/deploy-monitor/llama/deploy-pay-as-you-go.png":::
8583

articles/ai-studio/how-to/deploy-models-mistral.md

Lines changed: 20 additions & 21 deletions
Original file line numberDiff line numberDiff line change
@@ -5,53 +5,52 @@ description: Learn how to deploy Mistral Large with Azure AI Studio.
55
manager: scottpolly
66
ms.service: azure-ai-studio
77
ms.topic: how-to
8-
ms.date: 02/23/2024
9-
ms.reviewer: shubhiraj
10-
reviewer: shubhirajMsft
8+
ms.date: 3/6/2024
9+
ms.reviewer: shubhirajMsft
1110
ms.author: mopeakande
1211
author: msakande
1312
ms.custom: [references_regions]
14-
1513
---
14+
1615
# How to deploy Mistral models with Azure AI Studio
1716

18-
Mistral AI offers two categories of models in AI Studio:
17+
[!INCLUDE [Azure AI Studio preview](../includes/preview-ai-studio.md)]
18+
19+
In this article, you learn how to use Azure AI Studio to deploy the Mistral Large model as a service with pay-as you go billing.
20+
21+
Mistral AI offers two categories of models in [Azure AI Studio](https://ai.azure.com):
1922
* Premium models: Mistral Large. These models are available with pay-as-you-go token based billing with Models as a Service in the AI Studio model catalog.
2023
* Open models: Mixtral-8x7B-Instruct-v01, Mixtral-8x7B-v01, Mistral-7B-Instruct-v01, and Mistral-7B-v01. These models are also available in the AI Studio model catalog and can be deployed to dedicated VM instances in your own Azure subscription with Managed Online Endpoints.
2124

22-
You can browse the Mistral family of models in the Model Catalog by filtering on the Mistral collection.
25+
You can browse the Mistral family of models in the [Model Catalog](model-catalog.md) by filtering on the Mistral collection.
2326

2427
## Mistral Large
2528

26-
In this article, you learn how to use Azure AI Studio to deploy the Mistral Large model as a service with pay-as you go billing.
27-
2829
Mistral Large is Mistral AI's most advanced Large Language Model (LLM). It can be used on any language-based task thanks to its state-of-the-art reasoning and knowledge capabilities.
2930

3031
Additionally, mistral-large is:
3132

32-
* Specialized in RAG. Crucial information isn't lost in the middle of long context windows (up to 32 K tokens).
33+
* Specialized in RAG. Crucial information isn't lost in the middle of long context windows (up to 32-K tokens).
3334
* Strong in coding. Code generation, review, and comments. Supports all mainstream coding languages.
3435
* Multi-lingual by design. Best-in-class performance in French, German, Spanish, and Italian - in addition to English. Dozens of other languages are supported.
35-
* Responsible AI. Efficient guardrails baked in the model, with additional safety layer with safe_mode option.
36-
37-
[!INCLUDE [Azure AI Studio preview](../includes/preview-ai-studio.md)]
36+
* Responsible AI. Efficient guardrails baked in the model and another safety layer with the `safe_mode` option.
3837

3938
## Deploy Mistral Large with pay-as-you-go
4039

4140
Certain models in the model catalog can be deployed as a service with pay-as-you-go, providing a way to consume them as an API without hosting them on your subscription, while keeping the enterprise security and compliance organizations need. This deployment option doesn't require quota from your subscription.
4241

43-
Mistral Large can be deployed as a service with pay-as-you-go, and is offered by Mistral AI through the Microsoft Azure Marketplace. Note that Mistral AI can change or update the terms of use and pricing of this model.
42+
Mistral Large can be deployed as a service with pay-as-you-go, and is offered by Mistral AI through the Microsoft Azure Marketplace. Mistral AI can change or update the terms of use and pricing of this model.
4443

4544
### Prerequisites
4645

4746
- An Azure subscription with a valid payment method. Free or trial Azure subscriptions won't work. If you don't have an Azure subscription, create a [paid Azure account](https://azure.microsoft.com/pricing/purchase-options/pay-as-you-go) to begin.
4847
- An [Azure AI hub resource](../how-to/create-azure-ai-resource.md).
4948

5049
> [!IMPORTANT]
51-
> Pay-as-you-go model deployment offering is only available in AI hubs created in **East US 2** and **France Central** regions.
50+
> For Mistral family models, the pay-as-you-go model deployment offering is only available with AI hubs created in **East US 2** and **France Central** regions.
5251
5352
- An [Azure AI project](../how-to/create-projects.md) in Azure AI Studio.
54-
- Azure role-based access controls (Azure RBAC) are used to grant access to operations in Azure AI Studio. To perform the steps in this article, your user account must be assigned the __Azure AI Developer role__ on the Resouce Group.
53+
- Azure role-based access controls (Azure RBAC) are used to grant access to operations in Azure AI Studio. To perform the steps in this article, your user account must be assigned the __Azure AI Developer role__ on the resource group.
5554

5655
For more information on permissions, see [Role-based access control in Azure AI Studio](../concepts/rbac-ai-studio.md).
5756

@@ -61,22 +60,22 @@ Mistral Large can be deployed as a service with pay-as-you-go, and is offered by
6160
To create a deployment:
6261

6362
1. Sign in to [Azure AI Studio](https://ai.azure.com).
64-
1. Go to the Azure AI Studio [model catalog](https://ai.azure.com/explore/models) under the **Explore** tab and search for Mistral-large.
63+
1. Select **Model catalog** from the **Explore** tab and search for *Mistral-large*.
6564

66-
Alternatively, you can initiate a deployment by starting from your project in AI Studio. From the **Build** tab of your project, select the **Deployments** option, then select **+ Create**.
65+
Alternatively, you can initiate a deployment by starting from your project in AI Studio. From the **Build** tab of your project, select **Deployments** > **+ Create**.
6766

6867
1. In the model catalog, on the model's **Details** page, select **Deploy** and then **Pay-as-you-go**.
6968

7069
:::image type="content" source="../media/deploy-monitor/mistral/mistral-deploy-pay-as-you-go.png" alt-text="A screenshot showing how to deploy a model with the pay-as-you-go option." lightbox="../media/deploy-monitor/mistral/mistral-deploy-pay-as-you-go.png":::
7170

72-
1. Select the project in which you want to deploy your model. To deploy the Mistral-large model your project must belong to the **East US 2** or **France Central** regions.
71+
1. Select the project in which you want to deploy your model. To deploy the Mistral-large model your project must be in the **East US 2** or **France Central** regions.
7372
1. In the deployment wizard, select the link to **Azure Marketplace Terms** to learn more about the terms of use.
7473
1. You can also select the **Marketplace offer details** tab to learn about pricing for the selected model.
7574
1. If this is your first time deploying the model in the project, you have to subscribe your project for the particular offering. This step requires that your account has the **Azure AI Developer role** permissions on the Resource Group, as listed in the prerequisites. Each project has its own subscription to the particular Azure Marketplace offering of the model, which allows you to control and monitor spending. Select **Subscribe and Deploy**. Currently you can have only one deployment for each model within a project.
7675

7776
:::image type="content" source="../media/deploy-monitor/mistral/mistral-deploy-marketplace-terms.png" alt-text="A screenshot showing the terms and conditions of a given model." lightbox="../media/deploy-monitor/mistral/mistral-deploy-marketplace-terms.png":::
7877

79-
1. Once you subscribe the project for the particular Azure Marketplace offering, subsequent deployments of the _same_ offering in the _same_ project don't require subscribing again. If this scenario applies to you, you will see a **Continue to deploy** option to select (Currently you can have only one deployment for each model within a project).
78+
1. Once you subscribe the project for the particular Azure Marketplace offering, subsequent deployments of the _same_ offering in the _same_ project don't require subscribing again. If this scenario applies to you, you'll see a **Continue to deploy** option to select (Currently you can have only one deployment for each model within a project).
8079

8180
:::image type="content" source="../media/deploy-monitor/mistral/mistral-deploy-pay-as-you-go-project.png" alt-text="A screenshot showing a project that is already subscribed to the offering." lightbox="../media/deploy-monitor/mistral/mistral-deploy-pay-as-you-go-project.png":::
8281

@@ -235,7 +234,7 @@ The following is an example response:
235234
}
236235
}
237236
```
238-
#### Additional inference examples
237+
#### More inference examples
239238

240239
| **Sample Type** | **Sample Notebook** |
241240
|----------------|----------------------------------------|
@@ -259,7 +258,7 @@ Quota is managed per deployment. Each deployment has a rate limit of 200,000 tok
259258

260259
## Content filtering
261260

262-
Models deployed as a service with pay-as-you-go are protected by Azure AI Content Safety. With Azure AI content safety, both the prompt and completion pass through an ensemble of classification models aimed at detecting and preventing the output of harmful content. The content filtering system detects and takes action on specific categories of potentially harmful content in both input prompts and output completions. Learn more about [Azure AI Content Safety](../concepts/content-filtering.md).
261+
Models deployed as a service with pay-as-you-go are protected by [Azure AI Content Safety](../../ai-services/content-safety/overview.md). With Azure AI content safety, both the prompt and completion pass through an ensemble of classification models aimed at detecting and preventing the output of harmful content. The content filtering system detects and takes action on specific categories of potentially harmful content in both input prompts and output completions. Learn more about [content filtering here](../concepts/content-filtering.md).
263262

264263
## Next steps
265264

0 commit comments

Comments
 (0)