Skip to content

Commit 778a393

Browse files
committed
Merge branch 'main' of https://github.com/MicrosoftDocs/azure-ai-docs-pr into deploy-online-endpoints
2 parents d1527a4 + 8bd496a commit 778a393

File tree

355 files changed

+5529
-12800
lines changed

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

355 files changed

+5529
-12800
lines changed

.acrolinx-config.edn

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,2 +1,2 @@
11
{:allowed-branchname-matches ["main" "release-.*"]
2-
:allowed-filename-matches ["(?i)articles/(?:(?!active-directory/saas-apps/toc.yml|role-based-access-control/resource-provider-operations.md|.*policy/samples/|.*resource-graph/samples/))" "(?i)includes/(?:(?!policy/reference/|policy/standards/|resource-graph/samples/))"]}
2+
:allowed-filename-matches ["articles"]}

.gitignore

Lines changed: 5 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -9,4 +9,8 @@ _site/
99
_themes*/
1010
_repo.*/
1111

12-
.openpublishing.buildcore.ps1
12+
.openpublishing.buildcore.ps1
13+
14+
# CoPilot instructions and prompts
15+
.github/copilot-instructions.md
16+
.github/prompts/*.md

articles/ai-foundry/concepts/model-benchmarks.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -9,8 +9,8 @@ ms.custom:
99
ms.topic: concept-article
1010
ms.date: 04/04/2025
1111
ms.reviewer: changliu2
12-
ms.author: mopeakande
13-
author: msakande
12+
ms.author: lagayhar
13+
author: lgayhardt
1414
---
1515

1616
# Model leaderboards in Azure AI Foundry portal (preview)

articles/ai-foundry/concepts/models-featured.md

Lines changed: 13 additions & 9 deletions
Original file line numberDiff line numberDiff line change
@@ -27,9 +27,9 @@ To perform inferencing with the models, some models such as [Nixtla's TimeGEN-1]
2727

2828
The Jamba family models are AI21's production-grade Mamba-based large language model (LLM) which uses AI21's hybrid Mamba-Transformer architecture. It's an instruction-tuned version of AI21's hybrid structured state space model (SSM) transformer Jamba model. The Jamba family models are built for reliable commercial use with respect to quality and performance.
2929

30-
| Model | Type | Capabilities |
31-
| ------ | ---- | --- |
32-
| [AI21-Jamba-1.5-Mini](https://ai.azure.com/explore/models/AI21-Jamba-1.5-Mini/version/1/registry/azureml-ai21) | [chat-completion](../model-inference/how-to/use-chat-completions.md?context=/azure/ai-foundry/context/context) | - **Input:** text (262,144 tokens) <br /> - **Output:** text (4,096 tokens) <br /> - **Tool calling:** Yes <br /> - **Response formats:** Text, JSON, structured outputs | |
30+
| Model | Type | Capabilities |
31+
| ------ | ---- | --- |
32+
| [AI21-Jamba-1.5-Mini](https://ai.azure.com/explore/models/AI21-Jamba-1.5-Mini/version/1/registry/azureml-ai21) | [chat-completion](../model-inference/how-to/use-chat-completions.md?context=/azure/ai-foundry/context/context) | - **Input:** text (262,144 tokens) <br /> - **Output:** text (4,096 tokens) <br /> - **Tool calling:** Yes <br /> - **Response formats:** Text, JSON, structured outputs |
3333
| [AI21-Jamba-1.5-Large](https://ai.azure.com/explore/models/AI21-Jamba-1.5-Large/version/1/registry/azureml-ai21) | [chat-completion](../model-inference/how-to/use-chat-completions.md?context=/azure/ai-foundry/context/context) | - **Input:** text (262,144 tokens) <br /> - **Output:** text (4,096 tokens) <br /> - **Tool calling:** Yes <br /> - **Response formats:** Text, JSON, structured outputs |
3434

3535

@@ -68,10 +68,12 @@ The following table lists the Cohere models that you can inference via the Azur
6868

6969
| Model | Type | Capabilities |
7070
| ------ | ---- | --- |
71+
| [Cohere-command-A](https://aka.ms/aistudio/landing/cohere-command-a) | [chat-completion](../model-inference/how-to/use-chat-completions.md?context=/azure/ai-foundry/context/context) | - **Input:** text (256,000 tokens) <br /> - **Output:** text (8,000 tokens) <br /> - **Tool calling:** Yes <br /> - **Response formats:** Text |
7172
| [Cohere-command-r-plus-08-2024](https://ai.azure.com/explore/models/Cohere-command-r-plus-08-2024/version/1/registry/azureml-cohere) | [chat-completion](../model-inference/how-to/use-chat-completions.md?context=/azure/ai-foundry/context/context) | - **Input:** text (131,072 tokens) <br /> - **Output:** text (4,096 tokens) <br /> - **Tool calling:** Yes <br /> - **Response formats:** Text, JSON |
7273
| [Cohere-command-r-08-2024](https://ai.azure.com/explore/models/Cohere-command-r-08-2024/version/1/registry/azureml-cohere) | [chat-completion](../model-inference/how-to/use-chat-completions.md?context=/azure/ai-foundry/context/context) | - **Input:** text (131,072 tokens) <br /> - **Output:** text (4,096 tokens) <br /> - **Tool calling:** Yes <br /> - **Response formats:** Text, JSON |
7374
| [Cohere-command-r-plus](https://ai.azure.com/explore/models/Cohere-command-r-plus/version/1/registry/azureml-cohere) <br> (deprecated) | [chat-completion](../model-inference/how-to/use-chat-completions.md?context=/azure/ai-foundry/context/context) | - **Input:** text (131,072 tokens) <br /> - **Output:** text (4,096 tokens) <br /> - **Tool calling:** Yes <br /> - **Response formats:** Text, JSON |
7475
| [Cohere-command-r](https://ai.azure.com/explore/models/Cohere-command-r/version/1/registry/azureml-cohere) <br> (deprecated)| [chat-completion](../model-inference/how-to/use-chat-completions.md?context=/azure/ai-foundry/context/context) | - **Input:** text (131,072 tokens) <br /> - **Output:** text (4,096 tokens) <br /> - **Tool calling:** Yes <br /> - **Response formats:** Text, JSON |
76+
| [Cohere-embed-4](https://aka.ms/aistudio/landing/cohere-embed-4) | [embeddings](../model-inference/how-to/use-embeddings.md?context=/azure/ai-foundry/context/context) <br /> [image-embeddings](../model-inference/how-to/use-image-embeddings.md?context=/azure/ai-foundry/context/context) | - **Input:** image, text <br /> - **Output:** image, text (128,000 tokens) <br /> - **Tool calling:** Yes <br /> - **Response formats:** image, text |
7577
| [Cohere-embed-v3-english](https://ai.azure.com/explore/models/Cohere-embed-v3-english/version/1/registry/azureml-cohere) | [embeddings](../model-inference/how-to/use-embeddings.md?context=/azure/ai-foundry/context/context) <br /> [image-embeddings](../model-inference/how-to/use-image-embeddings.md?context=/azure/ai-foundry/context/context) | - **Input:** text (512 tokens) <br /> - **Output:** Vector (1,024 dim.) |
7678
| [Cohere-embed-v3-multilingual](https://ai.azure.com/explore/models/Cohere-embed-v3-multilingual/version/1/registry/azureml-cohere) | [embeddings](../model-inference/how-to/use-embeddings.md?context=/azure/ai-foundry/context/context) <br /> [image-embeddings](../model-inference/how-to/use-image-embeddings.md?context=/azure/ai-foundry/context/context) | - **Input:** text (512 tokens) <br /> - **Output:** Vector (1,024 dim.) |
7779

@@ -207,10 +209,12 @@ For more examples of how to use Meta Llama models, see the following examples:
207209

208210
## Microsoft
209211

210-
Phi is a family of lightweight, state-of-the-art open models. These models were trained with Phi-3 datasets. The datasets include both synthetic data and the filtered, publicly available websites data, with a focus on high quality and reasoning-dense properties. The models underwent a rigorous enhancement process, incorporating both supervised fine-tuning, proximal policy optimization, and direct preference optimization to ensure precise instruction adherence and robust safety measures.
212+
Microsoft models include various model groups such as MAI models, Phi models, healthcare AI models, and more. To see all the available Microsoft models, view [the Microsoft model collection in Azure AI Foundry portal](https://ai.azure.com/explore/models?&selectedCollection=phi).
213+
211214

212215
| Model | Type | Capabilities |
213216
| ------ | ---- | ------------ |
217+
| [MAI-DS-R1](https://ai.azure.com/explore/models/MAI-DS-R1/version/1/registry/azureml) | [chat-completion with reasoning content](../model-inference/how-to/use-chat-reasoning.md?context=/azure/ai-foundry/context/context) | - **Input:** text (163,840 tokens) <br /> - **Output:** text (163,840 tokens) <br /> - **Tool calling:** No <br /> - **Response formats:** Text. |
214218
| [Phi-4-multimodal-instruct](https://ai.azure.com/explore/models/Phi-4-multimodal-instruct/version/1/registry/azureml) | [chat-completion (with image and audio content)](../model-inference/how-to/use-chat-multi-modal.md?context=/azure/ai-foundry/context/context) | - **Input:** text, images, and audio (131,072 tokens) <br /> - **Output:** text (4,096 tokens) <br /> - **Tool calling:** No <br /> - **Response formats:** Text |
215219
| [Phi-4-mini-instruct](https://ai.azure.com/explore/models/Phi-4-mini-instruct/version/1/registry/azureml) | [chat-completion](../model-inference/how-to/use-chat-completions.md?context=/azure/ai-foundry/context/context) | - **Input:** text (131,072 tokens) <br /> - **Output:** text (4,096 tokens) <br /> - **Tool calling:** No <br /> - **Response formats:** Text |
216220
| [Phi-4](https://ai.azure.com/explore/models/Phi-4/version/2/registry/azureml) | [chat-completion](../model-inference/how-to/use-chat-completions.md?context=/azure/ai-foundry/context/context) | - **Input:** text (16,384 tokens) <br /> - **Output:** text (16,384 tokens) <br /> - **Tool calling:** No <br /> - **Response formats:** Text |
@@ -224,12 +228,9 @@ Phi is a family of lightweight, state-of-the-art open models. These models were
224228
| [Phi-3-medium-128k-instruct](https://ai.azure.com/explore/models/Phi-3-medium-128k-instruct/version/6/registry/azureml) | [chat-completion](../model-inference/how-to/use-chat-completions.md?context=/azure/ai-foundry/context/context) | - **Input:** text (131,072 tokens) <br /> - **Output:** text (4,096 tokens) <br /> - **Tool calling:** No <br /> - **Response formats:** Text |
225229
| [Phi-3-medium-4k-instruct](https://ai.azure.com/explore/models/Phi-3-medium-4k-instruct/version/5/registry/azureml) | [chat-completion](../model-inference/how-to/use-chat-completions.md?context=/azure/ai-foundry/context/context) | - **Input:** text (4,096 tokens) <br /> - **Output:** text (4,096 tokens) <br /> - **Tool calling:** No <br /> - **Response formats:** Text |
226230

231+
#### Inference examples: Microsoft models
227232

228-
See [this model collection in Azure AI Foundry portal](https://ai.azure.com/explore/models?&selectedCollection=phi).
229-
230-
#### Inference examples: Microsoft Phi
231-
232-
For more examples of how to use Phi-3 family models, see the following examples:
233+
For more examples of how to use Microsoft models, see the following examples:
233234

234235
| Description | Language | Sample |
235236
|-------------------------------------------|-------------------|-----------------------------------------------------------------|
@@ -240,6 +241,9 @@ For more examples of how to use Phi-3 family models, see the following examples:
240241
| Llama-Index | Python | [Link](https://aka.ms/azureai/llamaindex) |
241242

242243

244+
See [the Microsoft model collection in Azure AI Foundry portal](https://ai.azure.com/explore/models?&selectedCollection=phi).
245+
246+
243247
## Mistral AI
244248

245249
Mistral AI offers two categories of models, namely:

articles/ai-foundry/how-to/benchmark-model-in-catalog.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -10,8 +10,8 @@ ms.topic: how-to
1010
ms.date: 04/07/2025
1111
ms.reviewer: changliu2
1212
reviewer: changliu2
13-
ms.author: mopeakande
14-
author: msakande
13+
ms.author: lagayhar
14+
author: lgayhardt
1515
---
1616

1717
# Compare and select models using the model leaderboard in Azure AI Foundry portal (preview)

articles/ai-foundry/how-to/configure-private-link.md

Lines changed: 36 additions & 40 deletions
Original file line numberDiff line numberDiff line change
@@ -10,6 +10,7 @@ ms.date: 01/15/2025
1010
ms.reviewer: meerakurup
1111
ms.author: larryfr
1212
author: Blackmist
13+
zone_pivot_groups: azure-portal-and-cli
1314
# Customer intent: As an admin, I want to configure a private link for hub so that I can secure my hubs.
1415
---
1516

@@ -25,7 +26,6 @@ You get several hub default resources in your resource group. You need to config
2526
- Establish private endpoint connection to hub default resources. You need to have both a blob and file private endpoint for the default storage account.
2627
- If your storage account is private, [assign roles](#private-storage-configuration) to allow access.
2728

28-
2929
## Prerequisites
3030

3131
* You must have an existing Azure Virtual Network to create the private endpoint in.
@@ -37,9 +37,9 @@ You get several hub default resources in your resource group. You need to config
3737

3838
## Create a hub that uses a private endpoint
3939

40-
If you are creating a new hub, use the following tabs to select how you are creating the hub (Azure portal or Azure CLI.) Each of these methods __requires an existing virtual network__:
40+
If you are creating a new hub, use the following methods to create the hub (Azure portal or Azure CLI). Each of these methods __requires an existing virtual network__:
4141

42-
# [Azure portal](#tab/azure-portal)
42+
:::zone pivot="azure-portal"
4343

4444
> [!NOTE]
4545
> The information in this document is only about configuring a private link. For a walkthrough of creating a secure hub in the portal, see [Create a secure hub in the Azure portal](create-secure-ai-hub.md).
@@ -55,7 +55,9 @@ If you are creating a new hub, use the following tabs to select how you are crea
5555

5656
1. Input required fields. When selecting the __Region__, select the same region as your virtual network.
5757

58-
# [Azure CLI](#tab/cli)
58+
:::zone-end
59+
60+
:::zone pivot="cli"
5961

6062
> [!NOTE]
6163
> The information in this section doesn't cover basic hub configuration. For more information, see [Create a hub using the Azure CLI](./develop/create-hub-project-sdk.md?tabs=azurecli).
@@ -95,34 +97,17 @@ az network private-endpoint dns-zone-group create \
9597
--name myzonegroup \
9698
--private-dns-zone privatelink.api.azureml.ms \
9799
--zone-name privatelink.api.azureml.ms
98-
99-
# Add privatelink.notebooks.azure.net
100-
az network private-dns zone create \
101-
-g <resource-group-name> \
102-
--name privatelink.notebooks.azure.net
103-
104-
az network private-dns link vnet create \
105-
-g <resource-group-name> \
106-
--zone-name privatelink.notebooks.azure.net \
107-
--name <link-name> \
108-
--virtual-network <vnet-name> \
109-
--registration-enabled false
110-
111-
az network private-endpoint dns-zone-group add \
112-
-g <resource-group-name> \
113-
--endpoint-name <private-endpoint-name> \
114-
--name myzonegroup \
115-
--private-dns-zone privatelink.notebooks.azure.net \
116-
--zone-name privatelink.notebooks.azure.net
117100
```
118101

102+
:::zone-end
103+
119104
---
120105

121106
## Add a private endpoint to a hub
122107

123108
Use one of the following methods to add a private endpoint to an existing hub:
124109

125-
# [Azure portal](#tab/azure-portal)
110+
:::zone pivot="azure-portal"
126111

127112
1. From the [Azure portal](https://portal.azure.com), select your hub.
128113
1. From the left side of the page, select __Settings__, __Networking__, and then select the __Private endpoint connections__ tab. Select __+ Private endpoint__.
@@ -131,13 +116,15 @@ Use one of the following methods to add a private endpoint to an existing hub:
131116

132117
1. When going through the forms to create a private endpoint, be sure to:
133118

134-
- From __Basics__, select the same the __Region__ as your virtual network.
119+
- From __Basics__, select the same __Region__ as your virtual network.
135120
- From __Resource__, select `amlworkspace` as the __target sub-resource__.
136121
- From the __Virtual Network__ form, select the virtual network and subnet that you want to connect to.
137122

138123
1. After populating the forms with any additional network configurations you require, use the __Review + create__ tab to review your settings and select __Create__ to create the private endpoint.
139124

140-
# [Azure CLI](#tab/cli)
125+
:::zone-end
126+
127+
:::zone pivot="cli"
141128

142129
Use the [Azure networking CLI commands](/cli/azure/network/private-endpoint#az-network-private-endpoint-create) to create a private link endpoint for the hub.
143130

@@ -159,11 +146,11 @@ To create the private DNS zone entries for the workspace, use the following comm
159146
# Add privatelink.api.azureml.ms
160147
az network private-dns zone create \
161148
-g <resource-group-name> \
162-
--name 'privatelink.api.azureml.ms'
149+
--name privatelink.api.azureml.ms
163150
164151
az network private-dns link vnet create \
165152
-g <resource-group-name> \
166-
--zone-name 'privatelink.api.azureml.ms' \
153+
--zone-name privatelink.api.azureml.ms \
167154
--name <link-name> \
168155
--virtual-network <vnet-name> \
169156
--registration-enabled false
@@ -172,17 +159,17 @@ az network private-endpoint dns-zone-group create \
172159
-g <resource-group-name> \
173160
--endpoint-name <private-endpoint-name> \
174161
--name myzonegroup \
175-
--private-dns-zone 'privatelink.api.azureml.ms' \
176-
--zone-name 'privatelink.api.azureml.ms'
162+
--private-dns-zone privatelink.api.azureml.ms \
163+
--zone-name privatelink.api.azureml.ms
177164
178165
# Add privatelink.notebooks.azure.net
179166
az network private-dns zone create \
180167
-g <resource-group-name> \
181-
--name 'privatelink.notebooks.azure.net'
168+
--name privatelink.notebooks.azure.net
182169
183170
az network private-dns link vnet create \
184171
-g <resource-group-name> \
185-
--zone-name 'privatelink.notebooks.azure.net' \
172+
--zone-name privatelink.notebooks.azure.net \
186173
--name <link-name> \
187174
--virtual-network <vnet-name> \
188175
--registration-enabled false
@@ -191,10 +178,12 @@ az network private-endpoint dns-zone-group add \
191178
-g <resource-group-name> \
192179
--endpoint-name <private-endpoint-name> \
193180
--name myzonegroup \
194-
--private-dns-zone 'privatelink.notebooks.azure.net' \
195-
--zone-name 'privatelink.notebooks.azure.net'
181+
--private-dns-zone privatelink.notebooks.azure.net \
182+
--zone-name privatelink.notebooks.azure.net
196183
```
197184

185+
:::zone-end
186+
198187
---
199188

200189
## Remove a private endpoint
@@ -206,24 +195,28 @@ You can remove one or all private endpoints for a hub. Removing a private endpoi
206195
207196
To remove a private endpoint, use the following information:
208197

209-
# [Azure portal](#tab/azure-portal)
198+
:::zone pivot="azure-portal"
210199

211200
1. From the [Azure portal](https://portal.azure.com), select your hub.
212201
1. From the left side of the page, select __Settings__, __Networking__, and then select the __Private endpoint connections__ tab.
213202
1. Select the endpoint to remove and then select __Remove__.
214203

215204
:::image type="content" source="../media/how-to/network/remove-private-endpoint.png" alt-text="Screenshot of a selected private endpoint with the remove option highlighted.":::
216205

217-
# [Azure CLI](#tab/cli)
206+
:::zone-end
207+
208+
:::zone pivot="cli"
218209

219210
When using the Azure CLI, use the following command to remove the private endpoint:
220211

221212
```azurecli
222213
az network private-endpoint delete \
223214
--name <private-endpoint-name> \
224-
--resource-group <resource-group-name> \
215+
--resource-group <resource-group-name>
225216
```
226217

218+
:::zone-end
219+
227220
---
228221

229222
## Enable public access
@@ -235,13 +228,15 @@ In some situations, you might want to allow someone to connect to your secured h
235228
236229
To enable public access, use the following steps:
237230

238-
# [Azure portal](#tab/azure-portal)
231+
:::zone pivot="azure-portal"
239232

240233
1. From the [Azure portal](https://portal.azure.com), select your hub.
241234
1. From the left side of the page, select __Networking__ and then select the __Public access__ tab.
242235
1. Select __Enabled from all networks__, and then select __Save__.
243236

244-
# [Azure CLI](#tab/cli)
237+
:::zone-end
238+
239+
:::zone pivot="cli"
245240

246241
Use the following Azure CLI command to enable public access:
247242

@@ -255,8 +250,9 @@ If you receive an error that the `ml` command isn't found, use the following com
255250
az extension add --name ml
256251
```
257252

258-
---
253+
:::zone-end
259254

255+
---
260256

261257
## Private storage configuration
262258

0 commit comments

Comments
 (0)