You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/machine-learning/how-to-troubleshoot-environments.md
+20-19Lines changed: 20 additions & 19 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -23,7 +23,7 @@ Azure Machine Learning environments are an encapsulation of the environment wher
23
23
They specify the base docker image, Python packages, and software settings around your training and scoring scripts.
24
24
Environments are managed and versioned assets within your Machine Learning workspace that enable reproducible, auditable, and portable machine learning workflows across various compute targets.
25
25
26
-
## Types of environments
26
+
###Types of environments
27
27
28
28
Environments can broadly be divided into three categories: curated, user-managed, and system-managed.
29
29
@@ -40,7 +40,7 @@ System-managed environments are used when you want conda to manage the Python en
40
40
A new isolated conda environment is materialized from your conda specification on top of a base Docker image. By default, common properties are added to the derived image.
41
41
Note that environment isolation implies that Python dependencies installed in the base image won't be available in the derived image.
42
42
43
-
## Create and manage environments
43
+
###Create and manage environments
44
44
45
45
You can create and manage environments from clients like AzureML Python SDK, AzureML CLI, AzureML Studio UI, VS code extension.
46
46
@@ -52,9 +52,9 @@ It also caches the environments in the Azure Container Registry associated with
52
52
Multiple environments with the same definition may result the same image, so the cached image will be reused.
53
53
Running a training script remotely requires the creation of a Docker image.
54
54
55
-
## Reproducibility and vulnerabilities
55
+
###Reproducibility and vulnerabilities
56
56
57
-
###Vulnerabilities
57
+
#### *Vulnerabilities*
58
58
59
59
Vulnerabilities can be addressed by upgrading to a newer version of a dependency or migrating to a different dependency that satisfies security
60
60
requirements. Mitigating vulnerabilities is time consuming and costly since it can require refactoring of code and infrastructure. With the prevalence
@@ -66,7 +66,7 @@ There are some ways to decrease the impact of vulnerabilities:
66
66
- Compartmentalize your environment so issues can be scoped and fixed in one place.
67
67
- Understand flagged vulnerabilities and their relevance to your scenario.
68
68
69
-
###Vulnerabilities vs Reproducibility
69
+
#### *Vulnerabilities vs Reproducibility*
70
70
71
71
Reproducibility is one of the foundations of software development. While developing production code, a repeated operation must guarantee the same
72
72
result. Mitigating vulnerabilities can disrupt reproducibility by changing dependencies.
@@ -102,7 +102,7 @@ automate this process based on triggers from Microsoft Defender, see [Automate r
102
102
103
103
## **Environment definition problems**
104
104
105
-
###*Environment name issues*
105
+
## *Environment name issues*
106
106
### Curated prefix not allowed
107
107
<!--issueDescription-->
108
108
This issue can happen when the name of your custom environment uses terms reserved only for curated environments. *Curated* environments are environments that Microsoft maintains. *Custom* environments are environments that you create and maintain.
@@ -135,7 +135,7 @@ This issue can happen when the name of your custom environment uses terms reserv
135
135
136
136
Update your environment name to be 255 characters or less
137
137
138
-
###*Docker issues*
138
+
## *Docker issues*
139
139
140
140
*Applies to: Azure CLI & Python SDK v1*
141
141
@@ -456,7 +456,7 @@ Shorten your Dockerfile to get it under this limit
456
456
**Resources**
457
457
* See [best practices](https://docs.docker.com/develop/develop-images/dockerfile_best-practices/)
458
458
459
-
###*Docker build context issues*
459
+
## *Docker build context issues*
460
460
### Missing Docker build context location
461
461
<!--issueDescription-->
462
462
**Potential causes:**
@@ -584,7 +584,7 @@ For scenarios in which you're storing your Docker build context in a storage acc
@@ -636,7 +636,7 @@ Include at least one of the following on your specified base image
636
636
* Digest
637
637
* See [image with immutable identifier](https://aka.ms/azureml/environment/pull-image-by-digest)
638
638
639
-
###*Environment variable issues*
639
+
## *Environment variable issues*
640
640
### Misplaced runtime variables
641
641
<!--issueDescription-->
642
642
**Potential causes:**
@@ -652,7 +652,7 @@ Include at least one of the following on your specified base image
652
652
653
653
Use the `environment_variables` attribute on the [RunConfiguration object](https://aka.ms/azureml/environment/environment-variables-on-run-config) instead
654
654
655
-
###*Python issues*
655
+
## *Python issues*
656
656
### Python section missing
657
657
<!--issueDescription-->
658
658
**Potential causes:**
@@ -797,7 +797,7 @@ channels:
797
797
**Resources**
798
798
* See [conda package pinning](https://aka.ms/azureml/environment/how-to-pin-conda-packages)
799
799
800
-
### *Conda issues*
800
+
## *Conda issues*
801
801
### Missing conda dependencies
802
802
<!--issueDescription-->
803
803
**Potential causes:**
@@ -916,7 +916,7 @@ environment definition
916
916
version of a package on subsequent builds of an environment. This behavior can lead to unexpected errors
917
917
- See [conda package pinning](https://aka.ms/azureml/environment/how-to-pin-conda-packages)
918
918
919
-
### *Pip issues*
919
+
## *Pip issues*
920
920
### Pip not specified
921
921
- For reproducibility, pip should be specified as a dependency in your conda specification, and it should be pinned
922
922
- See [how to set a conda dependency](https://aka.ms/azureml/environment/add-conda-package-v1)
@@ -930,18 +930,19 @@ image builds on the environment
930
930
- See [conda package pinning](https://aka.ms/azureml/environment/how-to-pin-conda-packages)
931
931
- See [how to set pip as a dependency](https://aka.ms/azureml/environment/add-conda-package-v1)
932
932
933
-
### *Deprecated environment property issues*
933
+
## *Deprecated environment property issues*
934
934
### R section is deprecated
935
935
- The Azure Machine Learning SDK for R will be deprecated by the end of 2021 to make way for an improved R training and deployment
936
936
experience using Azure Machine Learning CLI 2.0
937
937
- See the [samples repository](https://aka.ms/azureml/environment/train-r-models-cli-v2) to get started with the edition CLI 2.0.
938
938
939
939
## **Image build problems**
940
940
941
-
### *Miscellaneous issues*
941
+
## *Miscellaneous issues*
942
942
### Build log unavailable
943
943
- Build logs are optional and not available for all environments since the image might already exist
944
944
945
+
## *ACR issues*
945
946
### ACR unreachable
946
947
<!--issueDescription-->
947
948
This issue can happen by failing to access a workspace's associated Azure Container Registry (ACR) resource.
@@ -986,7 +987,7 @@ az ml workspace update --name myworkspace --resource-group myresourcegroup --ima
0 commit comments