Skip to content

Commit 5c85bfb

Browse files
updating docs
1 parent 1609b0b commit 5c85bfb

File tree

3 files changed

+12
-42
lines changed

3 files changed

+12
-42
lines changed

articles/machine-learning/concept-prebuilt-docker-images-inference.md

Lines changed: 8 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -17,8 +17,6 @@ ms.custom: deploy, docker, prebuilt
1717

1818
Prebuilt Docker container images for inference are used when deploying a model with Azure Machine Learning. The images are prebuilt with popular machine learning frameworks and Python packages. You can also extend the packages to add other packages by using one of the following methods:
1919

20-
* [Use prebuilt inference image as base for a new Dockerfile](how-to-extend-prebuilt-docker-image-inference.md). Using this method, you can install both **Python packages and apt packages**.
21-
2220
## Why should I use prebuilt images?
2321

2422
* Reduces model deployment latency.
@@ -29,11 +27,16 @@ Prebuilt Docker container images for inference are used when deploying a model w
2927
## List of prebuilt Docker images for inference
3028

3129
> [!IMPORTANT]
32-
> The list provided below includes only **currently supported** inference images by Azure Machine Learning.
30+
> The list provided below includes only **currently supported** inference docker images by Azure Machine Learning.
3331
3432
[!INCLUDE [list-of-inference-prebuilt-docker-images](../../includes/aml-inference-list-prebuilt-docker-images.md)]
3533

34+
## How to use inference prebuilt docker images?
35+
36+
[Check examples in the Azure machine learning GitHub repository](https://github.com/Azure/azureml-examples/tree/main/cli/endpoints/online/custom-container)
37+
3638
## Next steps
3739

38-
* [Add Python packages to prebuilt images](how-to-prebuilt-docker-images-inference-python-extensibility.md).
39-
* [Use a prebuilt package as a base for a new Dockerfile](how-to-extend-prebuilt-docker-image-inference.md).
40+
* [Deploy and score a machine learning model by using an online endpoint](how-to-deploy-managed-online-endpoints.md)
41+
* [Learn more about custom containers](how-to-deploy-custom-container.md)
42+
* [azureml-examples GitHub repository](https://github.com/Azure/azureml-examples/tree/main/cli/endpoints/online)

articles/machine-learning/how-to-inference-server-http.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -175,7 +175,7 @@ You have **Flask 2** installed in your python environment but are running a serv
175175
ImportError: cannot import name 'Markup' from 'jinja2'
176176
```
177177
178-
Some older versions of the server do not have the correct boundaries for these dependencies. Please upgrade to the latest version of the server. We also recommend to not include these packages in their dependencies and rely on our server package to install the compatible versions of these dependencies.
178+
Older versions (<= 0.4.10) of the server did not pin Flask's dependency to compatible versions. This is fixed in the latest version of the server.
179179

180180
### 3. Do I need to reload the server when changing the score script?
181181

@@ -187,5 +187,5 @@ The Azure Machine Learning inference server runs on Windows & Linux based operat
187187

188188
## Next steps
189189

190-
* For more information on creating an entry script and deploying models, see [How to deploy a model using Azure Machine Learning](how-to-deploy-and-where.md).
190+
* For more information on creating an entry script and deploying models, see [How to deploy a model using Azure Machine Learning](how-to-deploy-managed-online-endpoints.md).
191191
* Learn about [Prebuilt docker images for inference](concept-prebuilt-docker-images-inference.md)

includes/aml-inference-list-prebuilt-docker-images.md

Lines changed: 2 additions & 35 deletions
Original file line numberDiff line numberDiff line change
@@ -12,45 +12,12 @@ ms.date: 07/14/2022
1212

1313
* All the docker images run as non-root user.
1414
* We recommend using `latest` tag for docker images. Prebuilt docker images for inference are published to Microsoft container registry (MCR), to query list of tags available, follow [instructions on the GitHub repository](https://github.com/microsoft/ContainerRegistry#browsing-mcr-content).
15+
* If you want to use a specific tag for any inference docker image, we support from `latest` to the tag that is *6 months* old from the `latest`.
1516

16-
### No framework
17+
### Inference minimal base images
1718

1819
Framework version | CPU/GPU | Pre-installed packages | MCR Path
1920
--- | --- | --- | --- |
2021
NA | CPU | NA | `mcr.microsoft.com/azureml/minimal-ubuntu18.04-py37-cpu-inference:latest`
2122
NA | GPU | NA | `mcr.microsoft.com/azureml/minimal-ubuntu18.04-py37-cuda11.0.3-gpu-inference:latest`
2223
NA | CPU | NA | `mcr.microsoft.com/azureml/minimal-ubuntu20.04-py38-cpu-inference:latest`
23-
24-
### TensorFlow
25-
26-
Framework version | CPU/GPU | Pre-installed packages | MCR Path
27-
--- | --- | --- | --- |
28-
2.4 | CPU | numpy>=1.16.0 </br> pandas~=1.1.x | `mcr.microsoft.com/azureml/tensorflow-2.4-ubuntu18.04-py37-cpu-inference:latest`
29-
2.4 | GPU | numpy >= 1.16.0 </br> pandas~=1.1.x </br> CUDA==11.0.3 </br> CuDNN==8.0.5.39 | `mcr.microsoft.com/azureml/tensorflow-2.4-ubuntu18.04-py37-cuda11.0.3-gpu-inference:latest`
30-
1.15 | CPU | pandas == 0.25.1 </br> numpy == 1.20.1 | `mcr.microsoft.com/azureml/tensorflow-1.15-ubuntu18.04-py37-cpu-inference:latest`
31-
32-
### PyTorch
33-
34-
Framework version | CPU/GPU | Pre-installed packages | MCR Path
35-
--- | --- | --- | --- |
36-
1.10 | CPU | numpy >= 1.16.0 </br> pandas >= 1.1, < 1.2 | `mcr.microsoft.com/azureml/pytorch-1.10-ubuntu18.04-py37-cpu-inference`
37-
1.9 | CPU | numpy >= 1.16.0 </br> pandas >= 1.1, < 1.2 | `mcr.microsoft.com/azureml/pytorch-1.9-ubuntu18.04-py37-cpu-inference:latest`
38-
1.9 | GPU | | `mcr.microsoft.com/azureml/pytorch-1.9-ubuntu18.04-py37-cuda11.0.3-gpu-inference:latest`
39-
40-
### SciKit-Learn
41-
42-
Framework version | CPU/GPU | Pre-installed packages | MCR Path
43-
--- | --- | --- | --- |
44-
0.24.1 | CPU | scikit-learn==0.24.1 </br> numpy>=1.16.0 </br> pandas~=1.1.x | `mcr.microsoft.com/azureml/sklearn-0.24.1-ubuntu18.04-py37-cpu-inference:latest`
45-
46-
### LightGBM
47-
48-
Framework version | CPU/GPU | Pre-installed packages | MCR Path
49-
--- | --- | --- | --- |
50-
3.2 | CPU | scikit-learn==0.24.1 </br> numpy>=1.16.0, <1.20 </br> pandas>=1.1, <1.2 | `mcr.microsoft.com/azureml/lightgbm-3.2-ubuntu18.04-py37-cpu-inference:latest`
51-
52-
### XGBoost
53-
54-
Framework version | CPU/GPU | Pre-installed packages | MCR Path
55-
--- | --- | --- | --- |
56-
0.9 | CPU | scikit-learn==0.23.2 </br> numpy==1.20.1 </br> pandas==0.25.1 | `mcr.microsoft.com/azureml/xgboost-0.9-ubuntu18.04-py37-cpu-inference:latest` |

0 commit comments

Comments
 (0)