You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/machine-learning/how-to-use-batch-endpoint.md
+27-19Lines changed: 27 additions & 19 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -192,6 +192,8 @@ A batch endpoint is an HTTPS endpoint that clients can call to trigger a batch s
192
192
# [Azure CLI](#tab/azure-cli)
193
193
194
194
The following YAML file defines a batch endpoint, which you can include in the CLI command for [batch endpoint creation](#create-a-batch-endpoint). In the repository, this file is located at `/cli/endpoints/batch/batch-endpoint.yml`.
@@ -254,6 +256,8 @@ Batch deployments require a scoring script that indicates how the given model sh
254
256
> [!TIP]
255
257
> For more information about how to write scoring scripts and best practices for it please see [Author scoring scripts for batch deployments](how-to-batch-scoring-script.md).
@@ -265,7 +269,7 @@ A deployment is a set of resources required for hosting the model that does the
265
269
* The environment in which the model runs.
266
270
* The pre-created compute and resource settings.
267
271
268
-
1. Create an environment where your batch deployment will run. Include in the environment any dependency your code requires for running. You will also need to add the library `azureml-core` as it is required for batch deployments to work.
272
+
1. Create an environment where your batch deployment will run. Include in the environment any dependency your code requires for running. In this case, the dependencies have been captured in a `conda.yml`.
269
273
270
274
# [Azure CLI](#tab/azure-cli)
271
275
@@ -284,25 +288,30 @@ A deployment is a set of resources required for hosting the model that does the
284
288
285
289
# [Studio](#tab/azure-studio)
286
290
291
+
On [Azure ML studio portal](https://ml.azure.com), follow these steps:
292
+
287
293
1. Navigate to the __Environments__ tab on the side menu.
288
294
1. Select the tab __Custom environments__ > __Create__.
289
295
1. Enter the name of the environment, in this case `torch-batch-env`.
290
296
1. On __Select environment type__ select __Use existing docker image with conda__.
291
297
1. On __Container registry image path__, enter `mcr.microsoft.com/azureml/openmpi3.1.2-ubuntu18.04`.
292
-
1. On __Customize__ section copy the content of the file `./mnist/environment/conda.yml` included in the repository into the portal. The conda file looks as follows:
> Curated environments are not supported in batch deployments. You will need to indicate your own environment. You can always use the base image of a curated environment as yours to simplify the process.
303
312
304
313
> [!IMPORTANT]
305
-
> Do not forget to include the library `azureml-core` in your deployment as it is required by the executor.
314
+
> The packages `azureml-core` and `azureml-dataset-runtime[fuse]` are required by batch deployments and should be included in the environment dependencies.
306
315
307
316
308
317
1. Create a deployment definition
@@ -376,7 +385,9 @@ A deployment is a set of resources required for hosting the model that does the
376
385
* `logging_level`- The log verbosity level. Allowed values are `warning`, `info`, `debug`. Default is `info`.
377
386
378
387
# [Studio](#tab/azure-studio)
379
-
388
+
389
+
On [Azure ML studio portal](https://ml.azure.com), follow these steps:
390
+
380
391
1. Navigate to the __Endpoints__ tab on the side menu.
381
392
1. Select the tab __Batch endpoints__ > __Create__.
382
393
1. Give the endpoint a name, in this case `mnist-batch`. You can configure the rest of the fields or leave them blank.
@@ -701,32 +712,29 @@ In this example, you will learn how to add a second deployment __that solves the
701
712
1. Enter the name of the environment, in this case `keras-batch-env`.
702
713
1. On __Select environment type__ select __Use existing docker image with conda__.
703
714
1. On __Container registry image path__, enter `mcr.microsoft.com/azureml/openmpi3.1.2-ubuntu18.04`.
704
-
1. On __Customize__ section copy the content of the file`./mnist-keras/environment/conda.yml` included in the repository into the portal. The conda file looks as follows:
1. On __Customize__ section copy the content of the file`./mnist-keras/environment/conda.yml` included in the repository into the portal.
708
716
1. Click on __Next__ and then on __Create__.
709
717
1. The environment is ready to be used.
710
718
711
719
---
712
-
713
-
> [!WARNING]
714
-
> Curated environments are not supported in batch deployments. You will need to indicate your own environment. You can always use the base image of a curated environment as yours to simplify the process.
715
-
716
-
> [!IMPORTANT]
717
-
> Do not forget to include the library `azureml-core`in your deployment as it is required by the executor.
0 commit comments