Skip to content

Commit 53f2569

Browse files
authored
Update how-to-use-batch-endpoint.md
1 parent a909bb5 commit 53f2569

File tree

1 file changed

+2
-4
lines changed

1 file changed

+2
-4
lines changed

articles/machine-learning/how-to-use-batch-endpoint.md

Lines changed: 2 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -501,15 +501,13 @@ A deployment is a set of resources required for hosting the model that does the
501501
502502
Invoking a batch endpoint triggers a batch scoring job. A job `name` will be returned from the invoke response and can be used to track the batch scoring progress.
503503
504-
When running models for scoring in Batch Endpoints, you need to indicate the input data path where the endpoints should look for the data you want to score. Batch endpoints support reading files or folders that are located in different locations.
504+
When running models for scoring in Batch Endpoints, you need to indicate the input data path where the endpoints should look for the data you want to score. The following example shows how to start a new job over a sample data of the MNIST dataset stored in an Azure Storage Account:
505505
506506
> [!NOTE]
507507
> __How does parallelization work?__:
508508
>
509509
> Batch deployments distribute work at the file level, which means that a folder containing 100 files with mini-batches of 10 files will generate 10 batches of 10 files each. Notice that this will happen regardless of the size of the files involved. If your files are too big to be processed in large mini-batches we suggest to either split the files in smaller files to achieve a higher level of parallelism or to decrease the number of files per mini-batch. At this moment, batch deployment can't account for skews in the file's size distribution.
510510
511-
The following example shows how to start a new job over a sample data of the MNIST dataset stored in an Azure Storage Account:
512-
513511
# [Azure CLI](#tab/azure-cli)
514512
515513
:::code language="azurecli" source="~/azureml-examples-main/cli/endpoints/batch/deploy-models/mnist-classifier/deploy-and-run.sh" ID="start_batch_scoring_job" :::
@@ -549,7 +547,7 @@ job = ml_client.batch_endpoints.invoke(
549547

550548
---
551549

552-
To learn more about how the supported types and how to specify them read [Accessing data from batch endpoints jobs](how-to-access-data-batch-endpoints-jobs.md).
550+
Batch endpoints support reading files or folders that are located in different locations. To learn more about how the supported types and how to specify them read [Accessing data from batch endpoints jobs](how-to-access-data-batch-endpoints-jobs.md).
553551

554552
> [!TIP]
555553
> Local data folders/files can be used when executing batch endpoints from the Azure Machine Learning CLI or Azure Machine Learning SDK for Python. However, that operation will result in the local data to be uploaded to the default Azure Machine Learning Data Store of the workspace you are working on.

0 commit comments

Comments
 (0)