You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/ai-foundry/model-inference/how-to/quickstart-ai-project.md
+18-18Lines changed: 18 additions & 18 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -1,7 +1,7 @@
1
1
---
2
2
title: Configure your AI project to use Azure AI Foundry Models
3
3
titleSuffix: Azure AI Foundry
4
-
description: Learn how to upgrade your AI project to use models deployed in Azure AI Foundry Models in Azure AI Foundry
4
+
description: Learn how to upgrade your AI project to use models deployed in Azure AI Foundry Models in Azure AI Foundry Service
5
5
ms.service: azure-ai-model-inference
6
6
ms.topic: how-to
7
7
ms.date: 1/21/2025
@@ -26,13 +26,13 @@ Additionally, deploying models to Azure AI Foundry Models brings the extra benef
26
26
> * Global capacity deployment type.
27
27
> *[Key-less authentication](configure-entra-id.md) with role-based access control.
28
28
29
-
In this article, you learn how to configure your project to use models deployed in Azure AI model inference in Azure AI services.
29
+
In this article, you learn how to configure your project to use Foundry Models deployments.
30
30
31
31
## Prerequisites
32
32
33
33
To complete this tutorial, you need:
34
34
35
-
* An Azure subscription. If you're using [GitHub Models](https://docs.github.com/en/github-models/), you can upgrade your experience and create an Azure subscription in the process. Read [Upgrade from GitHub Models to Azure AI model inference](quickstart-github-models.md) if it's your case.
35
+
* An Azure subscription. If you're using [GitHub Models](https://docs.github.com/en/github-models/), you can upgrade your experience and create an Azure subscription in the process. Read [Upgrade from GitHub Models to Foundry Models](quickstart-github-models.md) if it's your case.
36
36
37
37
* An Azure AI services resource. For more information, see [Create an Azure AI Services resource](../../../ai-services/multi-service-resource.md??context=/azure/ai-services/model-inference/context/context).
38
38
@@ -42,9 +42,9 @@ To complete this tutorial, you need:
42
42
> When your AI hub is provisioned, an Azure AI services resource is created with it and the two resources connected. To see which Azure AI services resource is connected to your project, go to the [Azure AI Foundry portal](https://ai.azure.com) > **Management center** > **Connected resources**, and find the connections of type **AI Services**.
43
43
44
44
45
-
## Configure the project to use Azure AI model inference
45
+
## Configure the project to use Foundry Models
46
46
47
-
To configure the project to use the Azure AI model inference capability in Azure AI Services, follow these steps:
47
+
To configure the project to use the Foundry Models capability in Azure AI Foundry Services, follow these steps:
48
48
49
49
1. Go to [Azure AI Foundry portal](https://ai.azure.com).
50
50
@@ -74,19 +74,19 @@ To configure the project to use the Azure AI model inference capability in Azure
74
74
75
75
7. Return to the project's landing page to continue and now select the new created connection. Refresh the page if it doesn't show up immediately.
76
76
77
-
4. Under **Included capabilities**, ensure you select **Azure AI Inference**. The **Azure AI model inference endpoint** URI is displayed along with the credentials to get access to it.
77
+
4. Under **Included capabilities**, ensure you select **Azure AI Inference**. The **Foundry Models endpoint** URI is displayed along with the credentials to get access to it.
78
78
79
79
:::image type="content" source="../media/quickstart-ai-project/overview-endpoint-and-key.png" alt-text="Screenshot of the landing page for the project, highlighting the location of the connected resource and the associated inference endpoint." lightbox="../media/quickstart-ai-project/overview-endpoint-and-key.png":::
80
80
81
81
> [!TIP]
82
-
> Each Azure AI services resource has a single **Azure AI model inference endpoint** which can be used to access any model deployment on it. The same endpoint serves multiple models depending on which ones are configured. Learn about [how the endpoint works](../concepts/endpoints.md#azure-ai-inference-endpoint).
82
+
> Each Azure AI Foundry Services resource has a single **Foundry Models endpoint** which can be used to access any model deployment on it. The same endpoint serves multiple models depending on which ones are configured. Learn about [how the endpoint works](../concepts/endpoints.md#azure-ai-inference-endpoint).
83
83
84
84
5. Take note of the endpoint URL and credentials.
85
85
86
86
87
-
### Create the model deployment in Azure AI model inference
87
+
### Create the model deployment in Foundry Models
88
88
89
-
For each model you want to deploy under Azure AI model inference, follow these steps:
89
+
For each model you want to deploy under Foundry Models, follow these steps:
90
90
91
91
1. Go to **Model catalog** section in [Azure AI Foundry portal](https://ai.azure.com/explore/models).
92
92
@@ -110,7 +110,7 @@ For each model you want to deploy under Azure AI model inference, follow these s
110
110
111
111
8. Select **Deploy**.
112
112
113
-
9. Once the deployment finishes, you see the endpoint URL and credentials to get access to the model. Notice that now the provided URL and credentials are the same as displayed in the landing page of the project for the **Azure AI model inference endpoint**.
113
+
9. Once the deployment finishes, you see the endpoint URL and credentials to get access to the model. Notice that now the provided URL and credentials are the same as displayed in the landing page of the project for the **Foundry Models endpoint**.
114
114
115
115
10. You can view all the models available under the resource by going to **Models + endpoints** section and locating the group for the connection to your AI Services resource:
116
116
@@ -139,11 +139,11 @@ Generate your first chat completion:
139
139
Use the parameter `model="<deployment-name>` to route your request to this deployment. *Deployments work as an alias of a given model under certain configurations*. See [Routing](../concepts/endpoints.md#routing) concept page to learn how Azure AI Services route deployments.
140
140
141
141
142
-
## Move from Serverless API Endpoints to Azure AI model inference
142
+
## Move from Serverless API Endpoints to Foundry Models
143
143
144
-
Although you configured the project to use the Azure AI model inference, existing model deployments continue to exist within the project as Serverless API Endpoints. Those deployments aren't moved for you. Hence, you can progressively upgrade any existing code that reference previous model deployments. To start moving the model deployments, we recommend the following workflow:
144
+
Although you configured the project to use Foundry Models, existing model deployments continue to exist within the project as Serverless API Endpoints. Those deployments aren't moved for you. Hence, you can progressively upgrade any existing code that reference previous model deployments. To start moving the model deployments, we recommend the following workflow:
145
145
146
-
1. Recreate the model deployment in Azure AI model inference. This model deployment is accessible under the **Azure AI model inference endpoint**.
146
+
1. Recreate the model deployment in Foundry Models. This model deployment is accessible under the **Foundry Models endpoint**.
147
147
148
148
2. Upgrade your code to use the new endpoint.
149
149
@@ -152,11 +152,11 @@ Although you configured the project to use the Azure AI model inference, existin
152
152
153
153
### Upgrade your code with the new endpoint
154
154
155
-
Once the models are deployed under Azure AI Services, you can upgrade your code to use the Azure AI model inference endpoint. The main difference between how Serverless API endpoints and Azure AI model inference works reside in the endpoint URL and model parameter. While Serverless API Endpoints have a set of URI and key per each model deployment, Azure AI model inference has only one for all of them.
155
+
Once the models are deployed under Azure AI Foundry Services, you can upgrade your code to use the Foundry Models endpoint. The main difference between how Serverless API endpoints and Foundry Models works reside in the endpoint URL and model parameter. While Serverless API Endpoints have a set of URI and key per each model deployment, Foundry Models has only one for all of them.
156
156
157
157
The following table summarizes the changes you have to introduce:
158
158
159
-
| Property | Serverless API Endpoints |Azure AI Model Inference|
159
+
| Property | Serverless API Endpoints |Foundry Models|
| Credentials | One per model/endpoint. | One per Azure AI Services resource. You can use Microsoft Entra ID too. |
@@ -186,10 +186,10 @@ For each model deployed as Serverless API Endpoints, follow these steps:
186
186
187
187
## Limitations
188
188
189
-
Consider the following limitations when configuring your project to use Azure AI model inference:
189
+
Consider the following limitations when configuring your project to use Foundry Models:
190
190
191
-
* Only models supporting pay-as-you-go billing (Models as a Service) are available for deployment to Azure AI model inference. Models requiring compute quota from your subscription (Managed Compute), including custom models, can only be deployed within a given project as Managed Online Endpoints and continue to be accessible using their own set of endpoint URI and credentials.
192
-
* Models available as both pay-as-you-go billing and managed compute offerings are, by default, deployed to Azure AI model inference in Azure AI services resources. Azure AI Foundry portal doesn't offer a way to deploy them to Managed Online Endpoints. You have to turn off the feature mentioned at [Configure the project to use Azure AI model inference](#configure-the-project-to-use-azure-ai-model-inference) or use the Azure CLI/Azure ML SDK/ARM templates to perform the deployment.
191
+
* Only models supporting pay-as-you-go billing (Models as a Service) are available for deployment to Foundry Models. Models requiring compute quota from your subscription (Managed Compute), including custom models, can only be deployed within a given project as Managed Online Endpoints and continue to be accessible using their own set of endpoint URI and credentials.
192
+
* Models available as both pay-as-you-go billing and managed compute offerings are, by default, deployed to Foundry Models in Azure AI Foundry Services resources. Azure AI Foundry portal doesn't offer a way to deploy them to Managed Online Endpoints. You have to turn off the feature mentioned at [Configure the project to use Foundry Models](#configure-the-project-to-use-azure-ai-model-inference) or use the Azure CLI/Azure ML SDK/ARM templates to perform the deployment.
Copy file name to clipboardExpand all lines: articles/ai-foundry/model-inference/how-to/use-blocklists.md
+7-7Lines changed: 7 additions & 7 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -1,7 +1,7 @@
1
1
---
2
-
title: 'How to use blocklists with Azure AI model inference service in Azure AI services'
2
+
title: 'How to use blocklists with Azure AI Foundry Models in Azure AI Foundry Service'
3
3
titleSuffix: Azure AI Foundry
4
-
description: Learn how to use blocklists with Azure AI model inference service in Azure AI services
4
+
description: Learn how to use blocklists with Foundry Models in Azure AI Foundry Service.
5
5
manager: nitinme
6
6
ms.service: azure-ai-model-inference
7
7
ms.topic: how-to
@@ -11,19 +11,19 @@ ms.author: fasantia
11
11
ms.custom: ignite-2024, github-universe-2024
12
12
---
13
13
14
-
# How to use blocklists with Azure AI model inference service in Azure AI services
14
+
# How to use blocklists with Foundry Models in Azure AI Foundry services
15
15
16
16
The configurable content filters are sufficient for most content moderation needs. However, you may need to filter terms specific to your use case.
17
17
18
18
## Prerequisites
19
19
20
-
* An Azure subscription. If you're using [GitHub Models](https://docs.github.com/en/github-models/), you can upgrade your experience and create an Azure subscription in the process. Read [Upgrade from GitHub Models to Azure AI model inference](quickstart-github-models.md) if it's your case.
20
+
* An Azure subscription. If you're using [GitHub Models](https://docs.github.com/en/github-models/), you can upgrade your experience and create an Azure subscription in the process. Read [Upgrade from GitHub Models to Foundry Models](quickstart-github-models.md) if it's your case.
21
21
22
-
* An Azure AI services resource. For more information, see [Create an Azure AI Services resource](../../../ai-services/multi-service-resource.md?context=/azure/ai-services/model-inference/context/context).
22
+
* An Azure AI Foundry services resource. For more information, see [Create an Azure AI Foundry Services resource](../../../ai-services/multi-service-resource.md?context=/azure/ai-services/model-inference/context/context).
23
23
24
-
* An Azure AI Foundry project [connected to your Azure AI services resource](configure-project-connection.md).
24
+
* An Azure AI Foundry project [connected to your Azure AI Foundry services resource](configure-project-connection.md).
25
25
26
-
* A model deployment. See [Add and configure models to Azure AI services](create-model-deployments.md) for adding models to your resource.
26
+
* A model deployment. See [Add and configure models to Azure AI Foundry services](create-model-deployments.md) for adding models to your resource.
27
27
28
28
> [!NOTE]
29
29
> Blocklist (preview) is only supported for Azure OpenAI models.
0 commit comments