Skip to content

Commit 654851b

Browse files
Merge pull request #260159 from Blackmist/183741-include-cleanup
bulk update to incorporate single use includes into article
2 parents 205cc02 + 8410a8d commit 654851b

17 files changed

+135
-260
lines changed

articles/machine-learning/concept-prebuilt-docker-images-inference.md

Lines changed: 12 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -29,7 +29,18 @@ Prebuilt Docker container images for inference are used when deploying a model w
2929
> [!IMPORTANT]
3030
> The list provided below includes only **currently supported** inference docker images by Azure Machine Learning.
3131
32-
[!INCLUDE [list-of-inference-prebuilt-docker-images](includes/aml-inference-list-prebuilt-docker-images.md)]
32+
* All the docker images run as non-root user.
33+
* We recommend using `latest` tag for docker images. Prebuilt docker images for inference are published to Microsoft container registry (MCR), to query list of tags available, follow [instructions on the GitHub repository](https://github.com/microsoft/ContainerRegistry#browsing-mcr-content).
34+
* If you want to use a specific tag for any inference docker image, we support from `latest` to the tag that is *6 months* old from the `latest`.
35+
36+
**Inference minimal base images**
37+
38+
Framework version | CPU/GPU | Pre-installed packages | MCR Path
39+
--- | --- | --- | --- |
40+
NA | CPU | NA | `mcr.microsoft.com/azureml/minimal-ubuntu18.04-py37-cpu-inference:latest`
41+
NA | GPU | NA | `mcr.microsoft.com/azureml/minimal-ubuntu18.04-py37-cuda11.0.3-gpu-inference:latest`
42+
NA | CPU | NA | `mcr.microsoft.com/azureml/minimal-ubuntu20.04-py38-cpu-inference:latest`
43+
NA | GPU | NA | `mcr.microsoft.com/azureml/minimal-ubuntu20.04-py38-cuda11.6.2-gpu-inference:latest`
3344

3445
## How to use inference prebuilt docker images?
3546

articles/machine-learning/how-to-access-azureml-behind-firewall.md

Lines changed: 31 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -120,7 +120,37 @@ To allow the installation of R packages, allow __outbound__ traffic to `cloud.r-
120120
121121
## Scenario: Using compute cluster or compute instance with a public IP
122122

123-
[!INCLUDE [udr info for computes](includes/machine-learning-compute-user-defined-routes.md)]
123+
> [!IMPORTANT]
124+
> A compute instance or compute cluster without a public IP does not need inbound traffic from Azure Batch management and Azure Machine Learning services. However, if you have multiple computes and some of them use a public IP address, you will need to allow this traffic.
125+
126+
When using Azure Machine Learning __compute instance__ or __compute cluster__ (_with a public IP address_), allow inbound traffic from the Azure Machine Learning service. A compute instance or compute cluster _with no public IP_ (preview) __doesn't__ require this inbound communication. A Network Security Group allowing this traffic is dynamically created for you, however you may need to also create user-defined routes (UDR) if you have a firewall. When creating a UDR for this traffic, you can use either **IP Addresses** or **service tags** to route the traffic.
127+
128+
# [IP Address routes](#tab/ipaddress)
129+
130+
For the Azure Machine Learning service, you must add the IP address of both the __primary__ and __secondary__ regions. To find the secondary region, see the [Cross-region replication in Azure](/azure/availability-zones/cross-region-replication-azure). For example, if your Azure Machine Learning service is in East US 2, the secondary region is Central US.
131+
132+
To get a list of IP addresses of the Azure Machine Learning service, download the [Azure IP Ranges and Service Tags](https://www.microsoft.com/download/details.aspx?id=56519) and search the file for `AzureMachineLearning.<region>`, where `<region>` is your Azure region.
133+
134+
> [!IMPORTANT]
135+
> The IP addresses may change over time.
136+
137+
When creating the UDR, set the __Next hop type__ to __Internet__. This means the inbound communication from Azure skips your firewall to access the load balancers with public IPs of Compute Instance and Compute Cluster. UDR is required because Compute Instance and Compute Cluster will get random public IPs at creation, and you cannot know the public IPs before creation to register them on your firewall to allow the inbound from Azure to specific IPs for Compute Instance and Compute Cluster. The following image shows an example IP address based UDR in the Azure portal:
138+
139+
:::image type="content" source="./media/machine-learning-compute-user-defined-routes/user-defined-route.png" alt-text="Image of a user-defined route configuration":::
140+
141+
# [Service tag routes](#tab/servicetag)
142+
143+
Create user-defined routes for the `AzureMachineLearning` service tag.
144+
145+
The following command demonstrates adding a route for this service tag:
146+
147+
```azurecli
148+
az network route-table route create -g MyResourceGroup --route-table-name MyRouteTable -n AzureMLRoute --address-prefix AzureMachineLearning --next-hop-type Internet
149+
```
150+
151+
---
152+
153+
For information on configuring UDR, see [Route network traffic with a routing table](/azure/virtual-network/tutorial-create-route-table-portal).
124154

125155
## Scenario: Firewall between Azure Machine Learning and Azure Storage endpoints
126156

articles/machine-learning/includes/aml-create-in-portal.md

Lines changed: 0 additions & 52 deletions
This file was deleted.

articles/machine-learning/includes/aml-inference-list-prebuilt-docker-images.md

Lines changed: 0 additions & 24 deletions
This file was deleted.

articles/machine-learning/includes/machine-learning-compare-classic-aml.md

Lines changed: 0 additions & 25 deletions
This file was deleted.

articles/machine-learning/includes/machine-learning-compute-user-defined-routes.md

Lines changed: 0 additions & 39 deletions
This file was deleted.

articles/machine-learning/includes/machine-learning-create-arc-enabled-training-computer-target.md

Lines changed: 0 additions & 10 deletions
This file was deleted.

articles/machine-learning/includes/machine-learning-service-inference-config.md

Lines changed: 0 additions & 78 deletions
This file was deleted.

articles/machine-learning/includes/machine-learning-service-install-extension.md

Lines changed: 0 additions & 14 deletions
This file was deleted.

articles/machine-learning/includes/machine-learning-service-trusted-model.md

Lines changed: 0 additions & 9 deletions
This file was deleted.

0 commit comments

Comments
 (0)