You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/ai-studio/how-to/configure-managed-network.md
+34-32Lines changed: 34 additions & 32 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -1,44 +1,44 @@
1
1
---
2
-
title: How to configure a managed network for Azure AI
2
+
title: How to configure a managed network for Azure AI hubs
3
3
titleSuffix: Azure AI Studio
4
-
description: Learn how to configure a managed network for Azure AI
4
+
description: Learn how to configure a managed network for Azure AI hubs
5
5
manager: scottpolly
6
6
ms.service: azure-ai-studio
7
7
ms.custom:
8
8
- ignite-2023
9
9
ms.topic: how-to
10
-
ms.date: 02/13/2024
10
+
ms.date: 3/30/2024
11
11
ms.reviewer: jhirono
12
12
ms.author: larryfr
13
13
author: Blackmist
14
14
---
15
15
16
-
# How to configure a managed network for Azure AI
16
+
# How to configure a managed network for Azure AI hubs
17
17
18
18
[!INCLUDE [Azure AI Studio preview](../includes/preview-ai-studio.md)]
19
19
20
-
We have two network isolation aspects. One is the network isolation to access an Azure AI. Another is the network isolation of computing resources in your Azure AI and Azure AI projects such as Compute Instance, Serverless and Managed Online Endpoint. This document explains the latter highlighted in the diagram. You can use Azure AI built-in network isolation to protect your computing resources.
20
+
We have two network isolation aspects. One is the network isolation to access an Azure AI hub. Another is the network isolation of computing resources in your Azure AI hub and Azure AI projects such as compute instance, serverless and managed online endpoint. This document explains the latter highlighted in the diagram. You can use Azure AI hub built-in network isolation to protect your computing resources.
21
21
22
-
:::image type="content" source="../media/how-to/network/azure-ai-network-outbound.svg" alt-text="Diagram of Azure AI network isolation." lightbox="../media/how-to/network/azure-ai-network-outbound.png":::
22
+
:::image type="content" source="../media/how-to/network/azure-ai-network-outbound.svg" alt-text="Diagram of Azure AI hub network isolation." lightbox="../media/how-to/network/azure-ai-network-outbound.png":::
23
23
24
24
You need to configure following network isolation configurations.
25
25
26
26
- Choose network isolation mode. You have two options: allow internet outbound mode or allow only approved outbound mode.
27
-
- Create private endpoint outbound rules to your private Azure resources. Note that private Azure AI Services and Azure AI Search are not supported yet.
27
+
- Create private endpoint outbound rules to your private Azure resources. Note that private Azure AI services and Azure AI Search are not supported yet.
28
28
- If you use Visual Studio Code integration with allow only approved outbound mode, create FQDN outbound rules described in the [use Visual Studio Code](#scenario-use-visual-studio-code) section.
29
29
- If you use HuggingFace models in Models with allow only approved outbound mode, create FQDN outbound rules described in the [use HuggingFace models](#scenario-use-huggingface-models) section.
30
30
31
31
## Network isolation architecture and isolation modes
32
32
33
-
When you enable managed virtual network isolation, a managed virtual network is created for the Azure AI. Managed compute resources you create for the Azure AI automatically use this managed VNet. The managed VNet can use private endpoints for Azure resources that are used by your Azure AI, such as Azure Storage, Azure Key Vault, and Azure Container Registry.
33
+
When you enable managed virtual network isolation, a managed virtual network is created for the Azure AI hub. Managed compute resources you create for the Azure AI hub automatically use this managed VNet. The managed VNet can use private endpoints for Azure resources that are used by your Azure AI hub, such as Azure Storage, Azure Key Vault, and Azure Container Registry.
34
34
35
35
There are three different configuration modes for outbound traffic from the managed VNet:
36
36
37
37
| Outbound mode | Description | Scenarios |
38
38
| ----- | ----- | ----- |
39
39
| Allow internet outbound | Allow all internet outbound traffic from the managed VNet. | You want unrestricted access to machine learning resources on the internet, such as python packages or pretrained models.<sup>1</sup> |
40
40
| Allow only approved outbound | Outbound traffic is allowed by specifying service tags. | * You want to minimize the risk of data exfiltration, but you need to prepare all required machine learning artifacts in your private environment.</br>* You want to configure outbound access to an approved list of services, service tags, or FQDNs. |
41
-
| Disabled | Inbound and outbound traffic isn't restricted. | You want public inbound and outbound from the Azure AI. |
41
+
| Disabled | Inbound and outbound traffic isn't restricted. | You want public inbound and outbound from the Azure AI hub. |
42
42
43
43
<sup>1</sup> You can use outbound rules with _allow only approved outbound_ mode to achieve the same result as using allow internet outbound. The differences are:
44
44
@@ -47,7 +47,7 @@ There are three different configuration modes for outbound traffic from the mana
47
47
* Adding FQDN outbound rules __increase your costs__ as this rule type uses Azure Firewall.
48
48
* The default rules for _allow only approved outbound_ are designed to minimize the risk of data exfiltration. Any outbound rules you add might increase your risk.
49
49
50
-
The managed VNet is preconfigured with [required default rules](#list-of-required-rules). It's also configured for private endpoint connections to your Azure AI, Azure AI's default storage, container registry and key vault __if they're configured as private__ or __the Azure AI isolation mode is set to allow only approved outbound__. After choosing the isolation mode, you only need to consider other outbound requirements you might need to add.
50
+
The managed VNet is preconfigured with [required default rules](#list-of-required-rules). It's also configured for private endpoint connections to your Azure AI hub, Azure AI hub's default storage, container registry and key vault __if they're configured as private__ or __the Azure AI hub isolation mode is set to allow only approved outbound__. After choosing the isolation mode, you only need to consider other outbound requirements you might need to add.
51
51
52
52
The following diagram shows a managed VNet configured to __allow internet outbound__:
53
53
@@ -56,7 +56,7 @@ The following diagram shows a managed VNet configured to __allow internet outbou
56
56
The following diagram shows a managed VNet configured to __allow only approved outbound__:
57
57
58
58
> [!NOTE]
59
-
> In this configuration, the storage, key vault, and container registry used by the Azure AI are flagged as private. Since they are flagged as private, a private endpoint is used to communicate with them.
59
+
> In this configuration, the storage, key vault, and container registry used by the Azure AI hub are flagged as private. Since they are flagged as private, a private endpoint is used to communicate with them.
60
60
61
61
:::image type="content" source="../media/how-to/network/only-approved-outbound.svg" alt-text="Diagram of managed VNet isolation configured for allow only approved outbound." lightbox="../media/how-to/network/only-approved-outbound.png":::
62
62
@@ -67,23 +67,24 @@ The following diagram shows a managed VNet configured to __allow only approved o
67
67
68
68
# [Azure CLI](#tab/azure-cli)
69
69
70
-
Not available in AI CLI, but you can use [Azure Machine Learning CLI](../../machine-learning/how-to-managed-network.md#configure-a-managed-virtual-network-to-allow-internet-outbound). Use your Azure AI name as workspace name in Azure Machine Learning CLI.
70
+
Not available in AI CLI, but you can use [Azure Machine Learning CLI](../../machine-learning/how-to-managed-network.md#configure-a-managed-virtual-network-to-allow-internet-outbound). Use your Azure AI hub name as workspace name in Azure Machine Learning CLI.
71
71
72
72
# [Python SDK](#tab/python)
73
73
74
74
Not available.
75
75
76
76
# [Azure portal](#tab/portal)
77
77
78
-
*__Create a new Azure AI__:
78
+
*__Create a new Azure AI hub__:
79
79
80
-
1. Sign in to the [Azure portal](https://portal.azure.com), and choose Azure AI from Create a resource menu.
80
+
1. Sign in to the [Azure portal](https://portal.azure.com), and choose Azure AI Studio from Create a resource menu.
81
+
1. Select **+ New Azure AI**.
81
82
1. Provide the required information on the __Basics__ tab.
82
83
1. From the __Networking__ tab, select __Private with Internet Outbound__.
83
84
1. To add an _outbound rule_, select __Add user-defined outbound rules__ from the __Networking__ tab. From the __Workspace outbound rules__ sidebar, provide the following information:
84
85
85
86
*__Rule name__: A name for the rule. The name must be unique for this workspace.
86
-
*__Destination type__: Private Endpoint is the only option when the network isolation is private with internet outbound. Azure AI managed VNet doesn't support creating a private endpoint to all Azure resource types. For a list of supported resources, see the [Private endpoints](#private-endpoints) section.
87
+
*__Destination type__: Private Endpoint is the only option when the network isolation is private with internet outbound. Azure AI hub managed VNet doesn't support creating a private endpoint to all Azure resource types. For a list of supported resources, see the [Private endpoints](#private-endpoints) section.
87
88
*__Subscription__: The subscription that contains the Azure resource you want to add a private endpoint for.
88
89
*__Resource group__: The resource group that contains the Azure resource you want to add a private endpoint for.
89
90
*__Resource type__: The type of the Azure resource.
@@ -96,7 +97,7 @@ Not available.
96
97
97
98
*__Update an existing workspace__:
98
99
99
-
1. Sign in to the [Azure portal](https://portal.azure.com), and select the Azure AI that you want to enable managed VNet isolation for.
100
+
1. Sign in to the [Azure portal](https://portal.azure.com), and select the Azure AI hub that you want to enable managed VNet isolation for.
100
101
1. Select __Networking__, then select __Private with Internet Outbound__.
101
102
102
103
* To _add_ an _outbound rule_, select __Add user-defined outbound rules__ from the __Networking__ tab. From the __Workspace outbound rules__ sidebar, provide the same information as used when creating a workspace in the 'Create a new workspace' section.
@@ -114,17 +115,18 @@ Not available.
114
115
115
116
# [Azure CLI](#tab/azure-cli)
116
117
117
-
Not available in AI CLI, but you can use [Azure Machine Learning CLI](../../machine-learning/how-to-managed-network.md#configure-a-managed-virtual-network-to-allow-only-approved-outbound). Use your Azure AI name as workspace name in Azure Machine Learning CLI.
118
+
Not available in AI CLI, but you can use [Azure Machine Learning CLI](../../machine-learning/how-to-managed-network.md#configure-a-managed-virtual-network-to-allow-only-approved-outbound). Use your Azure AI hub name as workspace name in Azure Machine Learning CLI.
118
119
119
120
# [Python SDK](#tab/python)
120
121
121
122
Not available.
122
123
123
124
# [Azure portal](#tab/portal)
124
125
125
-
*__Create a new Azure AI__:
126
+
*__Create a new Azure AI hub__:
126
127
127
-
1. Sign in to the [Azure portal](https://portal.azure.com), and choose Azure AI from Create a resource menu.
128
+
1. Sign in to the [Azure portal](https://portal.azure.com), and choose Azure AI Studio from Create a resource menu.
129
+
1. Select **+ New Azure AI**.
128
130
1. Provide the required information on the __Basics__ tab.
129
131
1. From the __Networking__ tab, select __Private with Approved Outbound__.
130
132
@@ -142,7 +144,7 @@ Not available.
142
144
*__Sub Resource__: The sub resource of the Azure resource type.
143
145
144
146
> [!TIP]
145
-
> Azure AI managed VNet doesn't support creating a private endpoint to all Azure resource types. For a list of supported resources, see the [Private endpoints](#private-endpoints) section.
147
+
> Azure AI hub managed VNet doesn't support creating a private endpoint to all Azure resource types. For a list of supported resources, see the [Private endpoints](#private-endpoints) section.
146
148
147
149
If the destination type is __Service Tag__, provide the following information:
148
150
@@ -163,7 +165,7 @@ Not available.
163
165
164
166
*__Update an existing workspace__:
165
167
166
-
1. Sign in to the [Azure portal](https://portal.azure.com), and select the Azure AI that you want to enable managed VNet isolation for.
168
+
1. Sign in to the [Azure portal](https://portal.azure.com), and select the Azure AI hub that you want to enable managed VNet isolation for.
167
169
1. Select __Networking__, then select __Private with Approved Outbound__.
168
170
169
171
* To _add_ an _outbound rule_, select __Add user-defined outbound rules__ from the __Networking__ tab. From the __Workspace outbound rules__ sidebar, provide the same information as when creating a workspace in the previous 'Create a new workspace' section.
@@ -179,15 +181,15 @@ Not available.
179
181
180
182
# [Azure CLI](#tab/azure-cli)
181
183
182
-
Not available in AI CLI, but you can use [Azure Machine Learning CLI](../../machine-learning/how-to-managed-network.md#manage-outbound-rules). Use your Azure AI name as workspace name in Azure Machine Learning CLI.
184
+
Not available in AI CLI, but you can use [Azure Machine Learning CLI](../../machine-learning/how-to-managed-network.md#manage-outbound-rules). Use your Azure AI hub name as workspace name in Azure Machine Learning CLI.
183
185
184
186
# [Python SDK](#tab/python)
185
187
186
188
Not available.
187
189
188
190
# [Azure portal](#tab/portal)
189
191
190
-
1. Sign in to the [Azure portal](https://portal.azure.com), and select the Azure AI that you want to enable managed VNet isolation for.
192
+
1. Sign in to the [Azure portal](https://portal.azure.com), and select the Azure AI hub that you want to enable managed VNet isolation for.
191
193
1. Select __Networking__. The __Azure AI Outbound access__ section allows you to manage outbound rules.
192
194
193
195
* To _add_ an _outbound rule_, select __Add user-defined outbound rules__ from the __Networking__ tab. From the __Azure AI outbound rules__ sidebar, provide the following information:
@@ -204,8 +206,8 @@ Not available.
204
206
> These rules are automatically added to the managed VNet.
205
207
206
208
__Private endpoints__:
207
-
* When the isolation mode for the managed VNet is `Allow internet outbound`, private endpoint outbound rules are automatically created as required rules from the managed VNet for the Azure AI and associated resources __with public network access disabled__ (Key Vault, Storage Account, Container Registry, Azure AI).
208
-
* When the isolation mode for the managed VNet is `Allow only approved outbound`, private endpoint outbound rules are automatically created as required rules from the managed VNet for the Azure AI and associated resources __regardless of public network access mode for those resources__ (Key Vault, Storage Account, Container Registry, Azure AI).
209
+
* When the isolation mode for the managed VNet is `Allow internet outbound`, private endpoint outbound rules are automatically created as required rules from the managed VNet for the Azure AI hub and associated resources __with public network access disabled__ (Key Vault, Storage Account, Container Registry, Azure AI hub).
210
+
* When the isolation mode for the managed VNet is `Allow only approved outbound`, private endpoint outbound rules are automatically created as required rules from the managed VNet for the Azure AI hub and associated resources __regardless of public network access mode for those resources__ (Key Vault, Storage Account, Container Registry, Azure AI hub).
209
211
210
212
__Outbound__ service tag rules:
211
213
@@ -244,7 +246,7 @@ To allow installation of __Python packages for training and deployment__, add ou
244
246
Visual Studio Code relies on specific hosts and ports to establish a remote connection.
245
247
246
248
#### Hosts
247
-
If you plan to use __Visual Studio Code__ with Azure AI, add outbound _FQDN_ rules to allow traffic to the following hosts:
249
+
If you plan to use __Visual Studio Code__ with the Azure AI hub, add outbound _FQDN_ rules to allow traffic to the following hosts:
248
250
249
251
> [!WARNING]
250
252
> FQDN outbound rules are implemented using Azure Firewall. If you use outbound FQDN rules, charges for Azure Firewall are included in your billing. For more information, see [Pricing](#pricing).
@@ -269,7 +271,7 @@ You must allow network traffic to ports 8704 to 8710. The VS Code server dynamic
269
271
270
272
### Scenario: Use HuggingFace models
271
273
272
-
If you plan to use __HuggingFace models__ with Azure AI, add outbound _FQDN_ rules to allow traffic to the following hosts:
274
+
If you plan to use __HuggingFace models__ with the Azure AI hub, add outbound _FQDN_ rules to allow traffic to the following hosts:
273
275
274
276
> [!WARNING]
275
277
> FQDN outbound rules are implemented using Azure Firewall. If you use outbound FQDN rules, charges for Azure Firewall are included in your billing. For more information, see [Pricing](#pricing).
@@ -285,7 +287,7 @@ If you plan to use __HuggingFace models__ with Azure AI, add outbound _FQDN_ rul
285
287
286
288
Private endpoints are currently supported for the following Azure services:
287
289
288
-
* Azure AI
290
+
* Azure AI hub
289
291
* Azure Machine Learning
290
292
* Azure Machine Learning registries
291
293
* Azure Storage (all sub resource types)
@@ -306,24 +308,24 @@ Private endpoints are currently supported for the following Azure services:
306
308
307
309
When you create a private endpoint, you provide the _resource type_ and _subresource_ that the endpoint connects to. Some resources have multiple types and subresources. For more information, see [what is a private endpoint](/azure/private-link/private-endpoint-overview).
308
310
309
-
When you create a private endpoint for Azure AI dependency resources, such as Azure Storage, Azure Container Registry, and Azure Key Vault, the resource can be in a different Azure subscription. However, the resource must be in the same tenant as the Azure AI.
311
+
When you create a private endpoint for Azure AI hub dependency resources, such as Azure Storage, Azure Container Registry, and Azure Key Vault, the resource can be in a different Azure subscription. However, the resource must be in the same tenant as the Azure AI hub.
310
312
311
313
A private endpoint is automatically created for a connection if the target resource is an Azure resource listed above. A valid target ID is expected for the private endpoint. A valid target ID for the connection can be the ARM ID of a parent resource. The target ID is also expected in the target of the connection or in `metadata.resourceid`. For more on connections, see [How to add a new connection in Azure AI Studio](connections-add.md).
312
314
313
315
## Pricing
314
316
315
-
The Azure AI managed VNet feature is free. However, you're charged for the following resources that are used by the managed VNet:
317
+
The Azure AI hub managed VNet feature is free. However, you're charged for the following resources that are used by the managed VNet:
316
318
317
319
* Azure Private Link - Private endpoints used to secure communications between the managed VNet and Azure resources relies on Azure Private Link. For more information on pricing, see [Azure Private Link pricing](https://azure.microsoft.com/pricing/details/private-link/).
318
-
* FQDN outbound rules - FQDN outbound rules are implemented using Azure Firewall. If you use outbound FQDN rules, charges for Azure Firewall are included in your billing. Azure Firewall SKU is standard. Azure Firewall is provisioned per Azure AI.
320
+
* FQDN outbound rules - FQDN outbound rules are implemented using Azure Firewall. If you use outbound FQDN rules, charges for Azure Firewall are included in your billing. Azure Firewall SKU is standard. Azure Firewall is provisioned per Azure AI hub.
319
321
320
322
> [!IMPORTANT]
321
323
> The firewall isn't created until you add an outbound FQDN rule. If you don't use FQDN rules, you will not be charged for Azure Firewall. For more information on pricing, see [Azure Firewall pricing](https://azure.microsoft.com/pricing/details/azure-firewall/).
322
324
323
325
## Limitations
324
326
325
327
* Azure AI Studio currently doesn't support bring your own virtual network, it only supports managed VNet isolation.
326
-
* Azure AI services provisioned with Azure AI and Azure AI Search attached with Azure AI should be public.
328
+
* Azure AI services provisioned with Azure AI hub and Azure AI Search attached with Azure AI hub should be public.
327
329
* The "Add your data" feature in the Azure AI Studio playground doesn't support private storage account.
328
330
* Once you enable managed VNet isolation of your Azure AI, you can't disable it.
329
331
* Managed VNet uses private endpoint connection to access your private resources. You can't have a private endpoint and a service endpoint at the same time for your Azure resources, such as a storage account. We recommend using private endpoints in all scenarios.
0 commit comments