You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
|`$schema`| string | The YAML schema. If you use the Azure Machine Learning VS Code extension to author the YAML file, including `$schema` at the top of your file enables you to invoke schema and resource completions. |||
31
31
|`type`| const |**Required.** The type of job. |`sweep`|`sweep`|
32
-
|`name`| string | Name of the job. Must be unique across all jobs in the workspace. If omitted, Azure Machine Learning will autogenerate a GUID for the name. |||
33
-
|`display_name`| string | Display name of the job in the studio UI. Can be non-unique within the workspace. If omitted, Azure Machine Learning will autogenerate a human-readable adjective-noun identifier for the display name. |||
34
-
|`experiment_name`| string | Experiment name to organize the job under. Each job's run record will be organized under the corresponding experiment in the studio's "Experiments" tab. If omitted, Azure Machine Learning will default it to the name of the working directory where the job was created. |||
32
+
|`name`| string | Name of the job. Must be unique across all jobs in the workspace. If omitted, Azure Machine Learning autogenerates a GUID for the name. |||
33
+
|`display_name`| string | Display name of the job in the studio UI. Can be nonunique within the workspace. If omitted, Azure Machine Learning autogenerates a human-readable adjective-noun identifier for the display name. |||
34
+
|`experiment_name`| string | Experiment name to organize the job under. The run record of each job is organized under the corresponding experiment in the studio's "Experiments" tab. If omitted, Azure Machine Learning defaults it to the name of the working directory where the job was created. |||
35
35
|`description`| string | Description of the job. |||
36
36
|`tags`| object | Dictionary of tags for the job. |||
37
37
|`sampling_algorithm`| object |**Required.** The hyperparameter sampling algorithm to use over the `search_space`. One of [RandomSamplingAlgorithm](#randomsamplingalgorithm), [GridSamplingAlgorithm](#gridsamplingalgorithm),or [BayesianSamplingAlgorithm](#bayesiansamplingalgorithm). |||
38
38
|`search_space`| object |**Required.** Dictionary of the hyperparameter search space. The key is the name of the hyperparameter and the value is the parameter expression. <br><br> Hyperparameters can be referenced in the `trial.command` using the `${{ search_space.<hyperparameter> }}` expression. |||
39
39
|`search_space.<hyperparameter>`| object | See [Parameter expressions](#parameter-expressions) for the set of possible expressions to use. |||
40
40
|`objective.primary_metric`| string |**Required.** The name of the primary metric reported by each trial job. The metric must be logged in the user's training script using `mlflow.log_metric()` with the same corresponding metric name. |||
41
41
|`objective.goal`| string |**Required.** The optimization goal of the `objective.primary_metric`. |`maximize`, `minimize`||
42
-
|`early_termination`| object | The early termination policy to use. A trial job is canceled when the criteria of the specified policy are met. If omitted, no early termination policy will be applied. One of [BanditPolicy](#banditpolicy), [MedianStoppingPolicy](#medianstoppingpolicy),or [TruncationSelectionPolicy](#truncationselectionpolicy). |||
42
+
|`early_termination`| object | The early termination policy to use. A trial job is canceled when the criteria of the specified policy are met. If omitted, no early termination policy is applied. One of [BanditPolicy](#banditpolicy), [MedianStoppingPolicy](#medianstoppingpolicy),or [TruncationSelectionPolicy](#truncationselectionpolicy). |||
43
43
|`limits`| object | Limits for the sweep job. See [Attributes of the `limits` key](#attributes-of-the-limits-key). |||
44
44
|`compute`| string |**Required.** Name of the compute target to execute the job on, using the `azureml:<compute_name>` syntax. |||
45
-
|`trial`| object |**Required.** The job template for each trial. Each trial job will be provided with a different combination of hyperparameter values that the system samples from the `search_space`. See [Attributes of the `trial` key](#attributes-of-the-trial-key). |||
45
+
|`trial`| object |**Required.** The job template for each trial. Each trial job is provided with a different combination of hyperparameter values that the system samples from the `search_space`. See [Attributes of the `trial` key](#attributes-of-the-trial-key). |||
46
46
|`inputs`| object | Dictionary of inputs to the job. The key is a name for the input within the context of the job and the value is the input value. <br><br> Inputs can be referenced in the `command` using the `${{ inputs.<input_name> }}` expression. |||
47
-
|`inputs.<input_name>`| number, integer, boolean, string or object | One of a literal value (of type number, integer, boolean, or string) or an object containing a [job input data specification](#job-inputs). |||
47
+
|`inputs.<input_name>`| number, integer, boolean, string, or object | One of a literal value (of type number, integer, boolean, or string) or an object containing a [job input data specification](#job-inputs). |||
48
48
|`outputs`| object | Dictionary of output configurations of the job. The key is a name for the output within the context of the job and the value is the output configuration. <br><br> Outputs can be referenced in the `command` using the `${{ outputs.<output_name> }}` expression. ||
49
-
|`outputs.<output_name>`| object | You can leave the object empty, in which case by default the output will be of type `uri_folder` and Azure Machine Learning will system-generate an output location for the output. File(s) to the output directory will be written via read-write mount. If you want to specify a different mode for the output, provide an object containing the [job output specification](#job-outputs). ||
50
-
|`identity`| object | The identity is used for data accessing. It can be [UserIdentityConfiguration](#useridentityconfiguration), [ManagedIdentityConfiguration](#managedidentityconfiguration) or None. If UserIdentityConfiguration, the identity of job submitter will be used to access input data and write result to output folder, otherwise, the managed identity of the compute target will be used. ||
49
+
|`outputs.<output_name>`| object | You can leave the object empty, in which case by default the output is of type `uri_folder` and Azure Machine Learning system-generates an output location for the output. All files to the output directory are written via read-write mount. If you want to specify a different mode for the output, provide an object containing the [job output specification](#job-outputs). ||
50
+
|`identity`| object | The identity is used for data accessing. It can be [User Identity Configuration](#useridentityconfiguration), [Managed Identity Configuration](#managedidentityconfiguration) or None. If UserIdentityConfiguration, the identity of job submitter is used to access input data and write result to output folder, otherwise, the managed identity of the compute target is used. ||
51
51
52
52
### Sampling algorithms
53
53
@@ -56,8 +56,8 @@ The source JSON schema can be found at https://azuremlschemas.azureedge.net/late
56
56
| Key | Type | Description | Allowed values | Default value |
|`type`| const |**Required.** The type of sampling algorithm. |`random`||
59
-
|`seed`| integer | A random seed to use for initializing the random number generation. If omitted, the default seed value will be null. |||
60
-
|`rule`| string | The type of random sampling to use. The default, `random`, will use simple uniform random sampling, while `sobol`will use the Sobol quasirandom sequence. |`random`, `sobol`|`random`|
59
+
|`seed`| integer | A random seed to use for initializing the random number generation. If omitted, the default seed value is null. |||
60
+
|`rule`| string | The type of random sampling to use. The default, `random`, uses simple uniform random sampling, while `sobol`uses the Sobol quasi-random sequence. |`random`, `sobol`|`random`|
61
61
62
62
#### GridSamplingAlgorithm
63
63
@@ -102,21 +102,21 @@ The source JSON schema can be found at https://azuremlschemas.azureedge.net/late
102
102
103
103
### Parameter expressions
104
104
105
-
#### choice
105
+
#### Choice
106
106
107
107
| Key | Type | Description | Allowed values |
108
108
| --- | ---- | ----------- | -------------- |
109
109
|`type`| const |**Required.** The type of expression. |`choice`|
110
110
|`values`| array |**Required.** The list of discrete values to choose from. ||
111
111
112
-
#### randint
112
+
#### Randint
113
113
114
114
| Key | Type | Description | Allowed values |
115
115
| --- | ---- | ----------- | -------------- |
116
116
|`type`| const |**Required.** The type of expression. |`randint`|
117
117
|`upper`| integer |**Required.** The exclusive upper bound for the range of integers. ||
118
118
119
-
#### qlognormal, qnormal
119
+
#### Qlognormal, qnormal
120
120
121
121
| Key | Type | Description | Allowed values |
122
122
| --- | ---- | ----------- | -------------- |
@@ -125,7 +125,7 @@ The source JSON schema can be found at https://azuremlschemas.azureedge.net/late
125
125
|`sigma`| number |**Required.** The standard deviation of the normal distribution. ||
126
126
|`q`| integer |**Required.** The smoothing factor. ||
127
127
128
-
#### qloguniform, quniform
128
+
#### Qloguniform, quniform
129
129
130
130
| Key | Type | Description | Allowed values |
131
131
| --- | ---- | ----------- | -------------- |
@@ -134,23 +134,23 @@ The source JSON schema can be found at https://azuremlschemas.azureedge.net/late
134
134
|`max_value`| number |**Required.** The maximum value in the range (inclusive). ||
135
135
|`q`| integer |**Required.** The smoothing factor. ||
136
136
137
-
#### lognormal, normal
137
+
#### Lognormal, normal
138
138
139
139
| Key | Type | Description | Allowed values |
140
140
| --- | ---- | ----------- | -------------- |
141
141
|`type`| const |**Required.** The type of expression. |`lognormal`, `normal`|
142
142
|`mu`| number |**Required.** The mean of the normal distribution. ||
143
143
|`sigma`| number |**Required.** The standard deviation of the normal distribution. ||
144
144
145
-
#### loguniform
145
+
#### Loguniform
146
146
147
147
| Key | Type | Description | Allowed values |
148
148
| --- | ---- | ----------- | -------------- |
149
149
|`type`| const |**Required.** The type of expression. |`loguniform`|
150
-
|`min_value`| number |**Required.** The minimum value in the range will be`exp(min_value)` (inclusive). ||
151
-
|`max_value`| number |**Required.** The maximum value in the range will be`exp(max_value)` (inclusive). ||
150
+
|`min_value`| number |**Required.** The minimum value in the range is`exp(min_value)` (inclusive). ||
151
+
|`max_value`| number |**Required.** The maximum value in the range is`exp(max_value)` (inclusive). ||
152
152
153
-
#### uniform
153
+
#### Uniform
154
154
155
155
| Key | Type | Description | Allowed values |
156
156
| --- | ---- | ----------- | -------------- |
@@ -164,16 +164,16 @@ The source JSON schema can be found at https://azuremlschemas.azureedge.net/late
164
164
| --- | ---- | ----------- | ------------- |
165
165
|`max_total_trials`| integer | The maximum number of trial jobs. |`1000`|
166
166
|`max_concurrent_trials`| integer | The maximum number of trial jobs that can run concurrently. | Defaults to `max_total_trials`. |
167
-
|`timeout`| integer | The maximum time in seconds the entire sweep job is allowed to run. Once this limit is reached, the system will cancel the sweep job, including all its trials. |`5184000`|
168
-
|`trial_timeout`| integer | The maximum time in seconds each trial job is allowed to run. Once this limit is reached, the system will cancel the trial. ||
167
+
|`timeout`| integer | The maximum time in seconds the entire sweep job is allowed to run. Once this limit is reached, the system cancels the sweep job, including all its trials. |`5184000`|
168
+
|`trial_timeout`| integer | The maximum time in seconds each trial job is allowed to run. Once this limit is reached, the system cancels the trial. ||
169
169
170
170
### Attributes of the `trial` key
171
171
172
172
| Key | Type | Description | Default value |
173
173
| --- | ---- | ----------- | ------------- |
174
174
|`command`| string |**Required.** The command to execute. ||
175
175
|`code`| string | Local path to the source code directory to be uploaded and used for the job. ||
176
-
|`environment`| string or object |**Required.** The environment to use for the job. This can be either a reference to an existing versioned environment in the workspace or an inline environment specification. <br> <br> To reference an existing environment, use the `azureml:<environment-name>:<environment-version>` syntax. <br><br> To define an environment inline, follow the [Environment schema](reference-yaml-environment.md#yaml-syntax). Exclude the `name` and `version` properties as they aren't supported for inline environments. ||
176
+
|`environment`| string or object |**Required.** The environment to use for the job. This value can be either a reference to an existing versioned environment in the workspace or an inline environment specification. <br> <br> To reference an existing environment, use the `azureml:<environment-name>:<environment-version>` syntax. <br><br> To define an environment inline, follow the [Environment schema](reference-yaml-environment.md#yaml-syntax). Exclude the `name` and `version` properties as they aren't supported for inline environments. ||
177
177
|`environment_variables`| object | Dictionary of environment variable name-value pairs to set on the process where the command is executed. ||
178
178
|`distribution`| object | The distribution configuration for distributed training scenarios. One of [MpiConfiguration](#mpiconfiguration), [PyTorchConfiguration](#pytorchconfiguration), or [TensorFlowConfiguration](#tensorflowconfiguration). ||
179
179
|`resources.instance_count`| integer | The number of nodes to use for the job. |`1`|
@@ -207,15 +207,15 @@ The source JSON schema can be found at https://azuremlschemas.azureedge.net/late
207
207
| Key | Type | Description | Allowed values | Default value |
|`type`| string | The type of job input. Specify `uri_file` for input data that points to a single file source, or `uri_folder` for input data that points to a folder source. [Learn more about data access.](concept-data.md)|`uri_file`, `uri_folder`, `mltable`, `mlflow_model`|`uri_folder`|
210
-
|`path`| string | The path to the data to use as input. This can be specified in a few ways: <br><br> - A local path to the data source file or folder, for example, `path: ./iris.csv`. The data will get uploaded during job submission. <br><br> - A URI of a cloud path to the file or folder to use as the input. Supported URI types are `azureml`, `https`, `wasbs`, `abfss`, `adl`. For more information on using the `azureml://` URI format, see [Core yaml syntax](reference-yaml-core-syntax.md). <br><br> - An existing registered Azure Machine Learning data asset to use as the input. To reference a registered data asset, use the `azureml:<data_name>:<data_version>` syntax or `azureml:<data_name>@latest` (to reference the latest version of that data asset), for example, `path: azureml:cifar10-data:1` or `path: azureml:cifar10-data@latest`. |||
211
-
|`mode`| string | Mode of how the data should be delivered to the compute target. <br><br> For read-only mount (`ro_mount`), the data will be consumed as a mount path. A folder will be mounted as a folder and a file will be mounted as a file. Azure Machine Learning will resolve the input to the mount path. <br><br> For `download` mode the data will be downloaded to the compute target. Azure Machine Learning will resolve the input to the downloaded path. <br><br> If you only want the URL of the storage location of the data artifact(s) rather than mounting or downloading the data itself, you can use the `direct` mode. This will pass in the URL of the storage location as the job input. In this case you're fully responsible for handling credentials to access the storage. |`ro_mount`, `download`, `direct`|`ro_mount`|
210
+
|`path`| string | The path to the data to use as input. This value can be specified in a few ways: <br><br> - A local path to the data source file or folder, for example, `path: ./iris.csv`. The data uploads during job submission. <br><br> - A URI of a cloud path to the file or folder to use as the input. Supported URI types are `azureml`, `https`, `wasbs`, `abfss`, `adl`. For more information on using the `azureml://` URI format, see [Core yaml syntax](reference-yaml-core-syntax.md). <br><br> - An existing registered Azure Machine Learning data asset to use as the input. To reference a registered data asset, use the `azureml:<data_name>:<data_version>` syntax or `azureml:<data_name>@latest` (to reference the latest version of that data asset), for example, `path: azureml:cifar10-data:1` or `path: azureml:cifar10-data@latest`. |||
211
+
|`mode`| string | Mode of how the data should be delivered to the compute target. <br><br> For read-only mount (`ro_mount`), the data is consumed as a mount path. A folder is mounted as a folder and a file is mounted as a file. Azure Machine Learning resolves the input to the mount path. <br><br> For `download` mode, the data is downloaded to the compute target. Azure Machine Learning resolves the input to the downloaded path. <br><br> If you only want the URL of the storage location of the data artifact or artifacts, rather than mounting or downloading the data itself, you can use the `direct` mode. This passes in the URL of the storage location as the job input. In this case, you're fully responsible for handling credentials to access the storage. |`ro_mount`, `download`, `direct`|`ro_mount`|
212
212
213
213
### Job outputs
214
214
215
215
| Key | Type | Description | Allowed values | Default value |
|`type`| string | The type of job output. For the default `uri_folder` type, the output will correspond to a folder. |`uri_file`, `uri_folder`, `mltable`, `mlflow_model`|`uri_folder`|
218
-
|`mode`| string | Mode of how output file(s) will get delivered to the destination storage. For read-write mount mode (`rw_mount`) the output directory will be a mounted directory. For upload mode the file(s) written will get uploaded at the end of the job. |`rw_mount`, `upload`|`rw_mount`|
217
+
|`type`| string | The type of job output. For the default `uri_folder` type, the output corresponds to a folder. |`uri_file`, `uri_folder`, `mltable`, `mlflow_model`|`uri_folder`|
218
+
|`mode`| string | Mode of how the output file or files are delivered to the destination storage. For the read-write mount mode (`rw_mount`), the output directory is a mounted directory. For the upload mode, all files written are uploaded at the end of the job. |`rw_mount`, `upload`|`rw_mount`|
219
219
220
220
### Identity configurations
221
221
@@ -237,7 +237,7 @@ The `az ml job` command can be used for managing Azure Machine Learning jobs.
237
237
238
238
## Examples
239
239
240
-
Examples are available in the [examples GitHub repository](https://github.com/Azure/azureml-examples/tree/main/cli/jobs). Several are shown below.
240
+
Examples are available in the [examples GitHub repository](https://github.com/Azure/azureml-examples/tree/main/cli/jobs). Several are shown here:
0 commit comments