You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: includes/machine-learning-service-inference-config.md
+39-10Lines changed: 39 additions & 10 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -1,5 +1,5 @@
1
1
---
2
-
author: larryfr
2
+
author: Blackmist
3
3
ms.service: machine-learning
4
4
ms.topic: include
5
5
ms.date: 11/06/2019
@@ -11,15 +11,16 @@ The entries in the `inferenceconfig.json` document map to the parameters for the
11
11
| JSON entity | Method parameter | Description |
12
12
| ----- | ----- | ----- |
13
13
|`entryScript`|`entry_script`| Path to a local file that contains the code to run for the image. |
14
-
|`runtime`|`runtime`| Which runtime to use for the image. Current supported runtimes are `spark-py` and `python`. |
15
-
|`condaFile`|`conda_file`| Optional. Path to a local file that contains a Conda environment definition to use for the image. |
16
-
|`extraDockerFileSteps`|`extra_docker_file_steps`| Optional. Path to a local file that contains additional Docker steps to run when setting up the image. |
14
+
|`runtime`|`runtime`|Optional. Which runtime to use for the image. Current supported runtimes are `spark-py` and `python`. If `environment` is set, this gets ignored. |
15
+
|`condaFile`|`conda_file`| Optional. Path to a local file that contains a Conda environment definition to use for the image. If `environment` is set, this gets ignored. |
16
+
|`extraDockerFileSteps`|`extra_docker_file_steps`| Optional. Path to a local file that contains additional Docker steps to run when setting up the image. If `environment` is set, this gets ignored.|
17
17
|`sourceDirectory`|`source_directory`| Optional. Path to folders that contain all files to create the image. |
18
-
|`enableGpu`|`enable_gpu`| Optional. Whether to enable GPU support in the image. The GPU image must be used on an Azure service, like Azure Container Instances, Azure Machine Learning Compute, Azure Virtual Machines, and Azure Kubernetes Service. The default is False. |
19
-
|`baseImage`|`base_image`| Optional. Custom image to be used as a base image. If no base image is provided, the image will be based on the provided runtime parameter. |
20
-
|`baseImageRegistry`|`base_image_registry`| Optional. Image registry that contains the base image. |
21
-
|`cudaVersion`|`cuda_version`| Optional. Version of CUDA to install for images that need GPU support. The GPU image must be used on an Azure service, like Azure Container Instances, Azure Machine Learning Compute, Azure Virtual Machines, and Azure Kubernetes Service. Supported versions are 9.0, 9.1, and 10.0. If `enable_gpu` is set, the default is 9.1. |
22
-
|`description`|`description`| A description for the image. |
18
+
|`enableGpu`|`enable_gpu`| Optional. Whether to enable GPU support in the image. The GPU image must be used on an Azure service, like Azure Container Instances, Azure Machine Learning Compute, Azure Virtual Machines, and Azure Kubernetes Service. The default is False. If `environment` is set, this gets ignored.|
19
+
|`baseImage`|`base_image`| Optional. Custom image to be used as a base image. If no base image is provided, the image will be based on the provided runtime parameter. If `environment` is set, this gets ignored. |
20
+
|`baseImageRegistry`|`base_image_registry`| Optional. Image registry that contains the base image. If `environment` is set, this gets ignored.|
21
+
|`cudaVersion`|`cuda_version`| Optional. Version of CUDA to install for images that need GPU support. The GPU image must be used on an Azure service, like Azure Container Instances, Azure Machine Learning Compute, Azure Virtual Machines, and Azure Kubernetes Service. Supported versions are 9.0, 9.1, and 10.0. If `enable_gpu` is set, the default is 9.1. If `environment` is set, this gets ignored. |
22
+
|`description`|`description`| A description for the image. If `environment` is set, this gets ignored. |
The following JSON is an example inference configuration for use with the CLI:
25
26
@@ -34,4 +35,32 @@ The following JSON is an example inference configuration for use with the CLI:
34
35
"baseImage": null,
35
36
"baseImageRegistry": null
36
37
}
37
-
```
38
+
```
39
+
40
+
The following JSON is an example inference configuration that uses an existing Azure Machine Learning [environment](https://docs.microsoft.com/python/api/azureml-core/azureml.core.environment.environment?view=azure-ml-py) with a specific version for use with the CLI:
41
+
42
+
```json
43
+
{
44
+
"entryScript": "score.py",
45
+
"environment":{
46
+
"name": "myenv",
47
+
"version": "1"
48
+
},
49
+
"condaFile": "myenv.yml",
50
+
"sourceDirectory": null
51
+
}
52
+
```
53
+
54
+
The following JSON is an example inference configuration that uses an existing Azure Machine Learning [environment](https://docs.microsoft.com/python/api/azureml-core/azureml.core.environment.environment?view=azure-ml-py) with latest version for use with the CLI:
0 commit comments