You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: includes/machine-learning-service-inference-config.md
-23Lines changed: 0 additions & 23 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -11,32 +11,9 @@ The entries in the `inferenceconfig.json` document map to the parameters for the
11
11
| JSON entity | Method parameter | Description |
12
12
| ----- | ----- | ----- |
13
13
|`entryScript`|`entry_script`| Path to a local file that contains the code to run for the image. |
14
-
|`runtime`|`runtime`| Optional. Which runtime to use for the image. Supported runtimes are `spark-py` and `python`. If `environment` is set, this entry is ignored. |
15
-
|`condaFile`|`conda_file`| Optional. Path to a local file that contains a Conda environment definition to use for the image. If `environment` is set, this entry is ignored. |
16
-
|`extraDockerFileSteps`|`extra_docker_file_steps`| Optional. Path to a local file that contains additional Docker steps to run when setting up the image. If `environment` is set, this entry is ignored.|
17
14
|`sourceDirectory`|`source_directory`| Optional. Path to folders that contain all files to create the image, which makes it easy to access any files within this folder or subfolder. You can upload an entire folder from your local machine as dependencies for the Webservice. Note: your entry_script, conda_file, and extra_docker_file_steps paths are relative paths to the source_directory path. |
18
-
|`enableGpu`|`enable_gpu`| Optional. Whether to enable GPU support in the image. The GPU image must be used on an Azure service, like Azure Container Instances. For example, Azure Machine Learning Compute, Azure Virtual Machines, and Azure Kubernetes Service. The default is False. If `environment` is set, this entry is ignored.|
19
-
|`baseImage`|`base_image`| Optional. Custom image to be used as a base image. If no base image is provided, the image will be based on the provided runtime parameter. If `environment` is set, this entry is ignored. |
20
-
|`baseImageRegistry`|`base_image_registry`| Optional. Image registry that contains the base image. If `environment` is set, this entry is ignored.|
21
-
|`cudaVersion`|`cuda_version`| Optional. Version of CUDA to install for images that need GPU support. The GPU image must be used on an Azure service. For example, Azure Container Instances, Azure Machine Learning Compute, Azure Virtual Machines, and Azure Kubernetes Service. Supported versions are 9.0, 9.1, and 10.0. If `enable_gpu` is set, the default is 9.1. If `environment` is set, this entry is ignored. |
22
-
|`description`|`description`| A description for the image. If `environment` is set, this entry is ignored. |
The following JSON is an example inference configuration for use with the CLI:
26
-
27
-
```json
28
-
{
29
-
"entryScript": "score.py",
30
-
"runtime": "python",
31
-
"condaFile": "myenv.yml",
32
-
"extraDockerfileSteps": null,
33
-
"sourceDirectory": null,
34
-
"enableGpu": false,
35
-
"baseImage": null,
36
-
"baseImageRegistry": null
37
-
}
38
-
```
39
-
40
17
You can include full specifications of an Azure Machine Learning [environment](https://docs.microsoft.com/python/api/azureml-core/azureml.core.environment.environment?view=azure-ml-py) in the inference configuration file. If this environment doesn't exist in your workspace, Azure Machine Learning will create it. Otherwise, Azure Machine Learning will update the environment if necessary. The following JSON is an example:
0 commit comments