Skip to content

Commit ea1d5f0

Browse files
Merge pull request #3349 from Blackmist/402367-fresh
freshness
2 parents 588db5b + 977a353 commit ea1d5f0

File tree

1 file changed

+11
-11
lines changed

1 file changed

+11
-11
lines changed

articles/machine-learning/v1/how-to-troubleshoot-prebuilt-docker-image-inference.md

Lines changed: 11 additions & 11 deletions
Original file line numberDiff line numberDiff line change
@@ -7,24 +7,24 @@ ms.service: azure-machine-learning
77
ms.subservice: inferencing
88
ms.author: larryfr
99
author: Blackmist
10-
ms.date: 08/15/2022
10+
ms.date: 03/05/2025
1111
ms.topic: how-to
1212
ms.reviewer: sehan
1313
ms.custom: UpdateFrequency5, deploy, docker, prebuilt, troubleshoot, devx-track-python
1414
---
1515
# Troubleshooting prebuilt docker images for inference
1616

17-
Learn how to troubleshoot problems you may see when using prebuilt docker images for inference with Azure Machine Learning.
17+
Learn how to troubleshoot problems you might see when using prebuilt docker images for inference with Azure Machine Learning.
1818

1919
> [!IMPORTANT]
20-
> Using [Python package extensibility for prebuilt Docker images](how-to-prebuilt-docker-images-inference-python-extensibility.md) with Azure Machine Learning is currently in preview. Preview functionality is provided "as-is", with no guarantee of support or service level agreement. For more information, see the [Supplemental terms of use for Microsoft Azure previews](https://azure.microsoft.com/support/legal/preview-supplemental-terms/).
20+
> Using [Python package extensibility for prebuilt Docker images](how-to-prebuilt-docker-images-inference-python-extensibility.md) with Azure Machine Learning is currently in preview. Preview functionality is provided "as-is," with no guarantee of support or service level agreement. For more information, see the [Supplemental terms of use for Microsoft Azure previews](https://azure.microsoft.com/support/legal/preview-supplemental-terms/).
2121
2222
## Model deployment failed
2323

24-
If model deployment fails, you won't see logs in [Azure Machine Learning studio](https://ml.azure.com/) and `service.get_logs()` will return None.
25-
If there is a problem in the init() function of score.py, `service.get_logs()` will return logs for the same.
24+
If model deployment fails, there are no logs created in [Azure Machine Learning studio](https://ml.azure.com/) and `service.get_logs()` returns no logs.
25+
If there's a problem in the init() function of score.py, `service.get_logs()` returns logs for the same.
2626

27-
So you'll need to run the container locally using one of the commands shown below and replace `<MCR-path>` with an image path. For a list of the images and paths, see [Prebuilt Docker images for inference](../concept-prebuilt-docker-images-inference.md).
27+
You need to run the container locally using one of the following commands and replace `<MCR-path>` with an image path. For a list of the images and paths, see [Prebuilt Docker images for inference](../concept-prebuilt-docker-images-inference.md).
2828

2929
### Mounting extensibility solution
3030

@@ -44,23 +44,23 @@ docker run -it -v $(pwd):/var/azureml-app -e AZUREML_EXTRA_REQUIREMENTS_TXT="req
4444

4545
## Enable local debugging
4646

47-
The local inference server allows you to quickly debug your entry script (`score.py`). In case the underlying score script has a bug, the server will fail to initialize or serve the model. Instead, it will throw an exception & the location where the issues occurred. [Learn more about Azure Machine Learning inference HTTP Server](../how-to-inference-server-http.md)
47+
The local inference server allows you to quickly debug your entry script (`score.py`). In case the underlying score script has a bug, the server fails to initialize or serve the model. Instead, it throws an exception & the location where the issues occurred. [Learn more about Azure Machine Learning inference HTTP Server](../how-to-inference-server-http.md)
4848

4949
## For common model deployment issues
5050

5151
For problems when deploying a model from Azure Machine Learning to Azure Container Instances (ACI) or Azure Kubernetes Service (AKS), see [Troubleshoot model deployment](how-to-troubleshoot-deployment.md).
5252

5353
## init() or run() failing to write a file
5454

55-
HTTP server in our Prebuilt Docker Images run as *non-root user*, it may not have access right to all directories.
55+
HTTP server in our Prebuilt Docker Images run as *non-root user*, it might not have access right to all directories.
5656
Only write to directories you have access rights to. For example, the `/tmp` directory in the container.
5757

5858
## Extra Python packages not installed
5959

6060
* Check if there's a typo in the environment variable or file name.
6161
* Check the container log to see if `pip install -r <your_requirements.txt>` is installed or not.
6262
* Check if source directory is set correctly in the [inference config](/python/api/azureml-core/azureml.core.model.inferenceconfig#constructor) constructor.
63-
* If installation not found and log says "file not found", check if the file name shown in the log is correct.
63+
* If installation not found and log says "file not found," check if the file name shown in the log is correct.
6464
* If installation started but failed or timed out, try to install the same `requirements.txt` locally with same Python and pip version in clean environment (that is, no cache directory; `pip install --no-cache-dir -r requriements.txt`). See if the problem can be reproduced locally.
6565

6666
## Mounting solution failed
@@ -73,7 +73,7 @@ Only write to directories you have access rights to. For example, the `/tmp` dir
7373

7474
## Building an image based on the prebuilt Docker image failed
7575

76-
* If failed during apt package installation, check if the user has been set to root before running the apt command? (Make sure switch back to non-root user)
76+
* If failed during apt package installation, check if the user is set to root before running the apt command? (Make sure switch back to non-root user)
7777

7878
## Run doesn't complete on GPU local deployment
7979

@@ -92,7 +92,7 @@ GPU base images can't be used for local deployment, unless the local deployment
9292
/var/azureml-app
9393
```
9494

95-
* If the `ENTRYPOINT` has been changed in the new built image, then the HTTP server and related components need to be loaded by `runsvdir /var/runit`
95+
* If the `ENTRYPOINT` is changed in the new built image, then the HTTP server and related components need to be loaded by `runsvdir /var/runit`
9696

9797
## Next steps
9898

0 commit comments

Comments
 (0)