You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/machine-learning/how-to-prepare-datasets-for-automl-images.md
+42-39Lines changed: 42 additions & 39 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -1,49 +1,52 @@
1
1
---
2
2
title: Prepare data for computer vision tasks
3
3
titleSuffix: Azure Machine Learning
4
-
description: Image data preparation for Azure Machine Learning automated ML to train computer vision models on classification, object detection, and segmentation
4
+
description: Learn about image data preparation for Azure Machine Learning to train computer vision models on classification, object detection, and segmentation.
5
5
author: ssalgadodev
6
6
ms.author: ssalgado
7
7
ms.service: azure-machine-learning
8
8
ms.subservice: automl
9
9
ms.topic: how-to
10
-
ms.custom: template-how-to, update-code, sdkv2,
10
+
ms.custom: template-how-to, update-code, sdkv2
11
11
ms.reviewer: rvadthyavath
12
-
ms.date: 03/26/2024
12
+
ms.date: 09/03/2024
13
+
#customer intent: As a data scientist, I want to prepare image data for training computer vision models.
13
14
---
14
15
15
16
# Prepare data for computer vision tasks with automated machine learning
> Support for training computer vision models with automated ML in Azure Machine Learning is an experimental public preview feature. Certain features might not be supported or might have constrained capabilities. For more information, see [Supplemental Terms of Use for Microsoft Azure Previews](https://azure.microsoft.com/support/legal/preview-supplemental-terms/).
22
22
23
-
In this article, you learn how to prepare image data for training computer vision models with [automated machine learning in Azure Machine Learning](concept-automated-ml.md).
23
+
In this article, you learn how to prepare image data for training computer vision models with [automated machine learning in Azure Machine Learning](concept-automated-ml.md).
24
24
25
-
To generate models for computer vision tasks with automated machine learning, you need to bring labeled image data as input for model training in the form of an `MLTable`.
25
+
To generate models for computer vision tasks with automated machine learning, you need to bring labeled image data as input for model training in the form of an `MLTable`.
26
26
27
-
You can create an `MLTable` from labeled training data in JSONL format.
28
-
If your labeled training data is in a different format (like, pascal VOC or COCO), you can use a [conversion script](https://github.com/Azure/azureml-examples/blob/v1-archive/v1/python-sdk/tutorials/automl-with-azureml/image-object-detection/coco2jsonl.py) to first convert it to JSONL, and then create an `MLTable`. Alternatively, you can use Azure Machine Learning's [data labeling tool](how-to-create-image-labeling-projects.md) to manually label images, and export the labeled data to use for training your AutoML model.
27
+
You can create an `MLTable` from labeled training data in JSONL format. If your labeled training data is in a different format (like, Pascal Visual Object Classes (VOC) or COCO), you can use a [conversion script](https://github.com/Azure/azureml-examples/blob/v1-archive/v1/python-sdk/tutorials/automl-with-azureml/image-object-detection/coco2jsonl.py) to first convert it to JSONL, and then create an `MLTable`. Alternatively, you can use Azure Machine Learning's data labeling tool to manually label images, and export the labeled data to use for training your AutoML model.
29
28
30
29
## Prerequisites
31
30
32
-
* Familiarize yourself with the accepted [schemas for JSONL files for AutoML computer vision experiments](reference-automl-images-schema.md).
31
+
- Familiarize yourself with the accepted [schemas for JSONL files for AutoML computer vision experiments](reference-automl-images-schema.md).
32
+
33
+
## Get labeled data
33
34
34
-
## Get labeled data
35
35
In order to train computer vision models using AutoML, you need to first get labeled training data. The images need to be uploaded to the cloud and label annotations need to be in JSONL format. You can either use the Azure Machine Learning Data Labeling tool to label your data or you could start with prelabeled image data.
36
36
37
-
### Using Azure Machine Learning Data Labeling tool to label your training data
38
-
If you don't have prelabeled data, you can use Azure Machine Learning's [data labeling tool](how-to-create-image-labeling-projects.md) to manually label images. This tool automatically generates the data required for training in the accepted format.
37
+
### Use Azure Machine Learning Data Labeling tool to label your training data
38
+
39
+
If you don't have prelabeled data, you can use Azure Machine Learning's data labeling tool to manually label images. This tool automatically generates the data required for training in the accepted format. For more information, see [Set up an image labeling project](how-to-create-image-labeling-projects.md).
39
40
40
-
It helps to create, manage, and monitor data labeling tasks for
41
+
It helps to create, manage, and monitor data labeling tasks for:
41
42
42
-
+ Image classification (multi-class and multi-label)
43
-
+ Object detection (bounding box)
44
-
+ Instance segmentation (polygon)
43
+
- Image classification (multi-class and multi-label)
44
+
- Object detection (bounding box)
45
+
- Instance segmentation (polygon)
45
46
46
-
If you already have labeled data you want to use, you can [export your labeled data as an Azure Machine Learning Dataset](how-to-manage-labeling-projects.md#export-the-labels) and then access the dataset under 'Datasets' tab in Azure Machine Learning studio. This exported dataset can then be passed as an input using `azureml:<tabulardataset_name>:<version>` format. Here's an example of how to pass existing dataset as input for training computer vision models.
47
+
If you already labeled data you want to use, you can export your labeled data as an Azure Machine Learning Dataset and access the dataset under the **Datasets** tab in Azure Machine Learning studio. This exported dataset can then be passed as an input using `azureml:<tabulardataset_name>:<version>` format. For more information, see [Export the labels](how-to-manage-labeling-projects.md#export-the-labels).
48
+
49
+
Here's an example of how to pass existing dataset as input for training computer vision models.
47
50
48
51
# [Azure CLI](#tab/cli)
49
52
@@ -77,18 +80,18 @@ Refer to CLI/SDK tabs for reference.
77
80
78
81
---
79
82
80
-
### Using prelabeled training data from local machine
81
-
If you have labeled data that you would like to use to train your model, you need to upload the images to Azure. You can upload the your images to the default Azure Blob Storage of your Azure Machine Learning Workspace and register it as a [data asset](how-to-create-data-assets.md).
83
+
### Use prelabeled training data from local machine
82
84
83
-
The following script uploads the image data on your local machine at path "./data/odFridgeObjects" to datastore in Azure Blob Storage. It then creates a new data asset with the name "fridge-items-images-object-detection" in your Azure Machine Learning Workspace.
85
+
If you labeled data that you would like to use to train your model, you need to upload the images to Azure. You can upload your images to the default Azure Blob Storage of your Azure Machine Learning Workspace and register it as a *data asset*. For more information, see [Create and manage data assets](how-to-create-data-assets.md).
84
86
87
+
The following script uploads the image data on your local machine at path *./data/odFridgeObjects* to datastore in Azure Blob Storage. It then creates a new data asset with the name `fridge-items-images-object-detection` in your Azure Machine Learning Workspace.
85
88
86
-
If there already exists a data asset with the name "fridge-items-images-object-detection" in your Azure Machine Learning Workspace, it updates the version number of the data asset and points it to the new location where the image data uploaded.
89
+
If there already exists a data asset with the name `fridge-items-images-object-detection` in your Azure Machine Learning Workspace, it updates the version number of the data asset and points it to the new location where the image data uploaded.
To upload the images as a data asset, you run the following CLI v2 command with the path to your .yml file, workspace name, resource group, and subscription ID.
104
+
To upload the images as a data asset, you run the following CLI v2 command with the path to your *.yml* file, workspace name, resource group, and subscription ID.
102
105
103
106
```azurecli
104
107
az ml data create -f [PATH_TO_YML_FILE] --workspace-name [YOUR_AZURE_WORKSPACE] --resource-group [YOUR_AZURE_RESOURCE_GROUP] --subscription [YOUR_AZURE_SUBSCRIPTION]
118
+
:::image type="content" source="media\how-to-prepare-datasets-for-automl-images\ui-dataset-local.gif" alt-text="Animation showing how to register a dataset from local files.":::
116
119
117
120
---
118
121
119
-
If you already have your data present in an existing datastore and want to create a data asset out of it, you can do so by providing the path to the data in the datastore, instead of providing the path of your local machine. Update the code [above](#using-prelabeled-training-data-from-local-machine) with the following snippet.
122
+
If you already have your data present in an existing datastore and want to create a data asset out of it, you provide the path to the data in the datastore, instead of the path of your local machine. Update [the prededing code](#using-prelabeled-training-data-from-local-machine) with the following snippet.
150
+
:::image type="content" source="media\how-to-prepare-datasets-for-automl-images\ui-dataset-datastore.gif" alt-text="Animation showing how to register a dataset from data already present in datastore.":::
149
151
150
152
---
151
153
152
-
Next, you need to get the label annotations in JSONL format. The schema of labeled data depends on the computer vision task at hand. Refer to [schemas for JSONL files for AutoML computer vision experiments](reference-automl-images-schema.md) to learn more about the required JSONL schema for each task type.
154
+
Next, you need to get the label annotations in JSONL format. The schema of labeled data depends on the computer vision task at hand. To learn more about the required JSONL schema for each task type, see [Data schemas to train computer vision models with automated machine learning](reference-automl-images-schema.md).
153
155
154
156
If your training data is in a different format (like, pascal VOC or COCO), [helper scripts](https://github.com/Azure/azureml-examples/blob/v1-archive/v1/python-sdk/tutorials/automl-with-azureml/image-object-detection/coco2jsonl.py) to convert the data to JSONL are available in [notebook examples](https://github.com/Azure/azureml-examples/blob/main/sdk/python/jobs/automl-standalone-jobs).
155
157
156
-
Once you created jsonl file following the above steps, you can register it as a data asset using UI. Make sure you select `stream` type in schema section as shown in this animation.
158
+
After you create the *.jsonl* file following the preceding steps, you can register it as a data asset using UI. Make sure you select `stream` type in schema section as shown in this animation.
157
159
158
-
160
+
:::image type="content" source="media\how-to-prepare-datasets-for-automl-images\ui-dataset-jsnol.gif" alt-text="Animation showing how to register a data asset from the jsonl files.":::
159
161
160
162
### Using prelabeled training data from Azure Blob storage
161
-
If you have your labeled training data present in a container in Azure Blob storage, then you can access it directly from there by [creating a datastore referring to that container](how-to-datastore.md#create-an-azure-blob-datastore).
163
+
164
+
If your labeled training data is present in a container in Azure Blob storage, you can access it directly from there by [creating a datastore referring to that container](how-to-datastore.md#create-an-azure-blob-datastore).
162
165
163
166
## Create MLTable
164
167
165
-
Once you have your labeled data in JSONL format, you can use it to create `MLTable` as shown in this yaml snippet. MLtable packages your data into a consumable object for training.
168
+
After your labeled data is in JSONL format, you can use it to create `MLTable` as shown in this yaml snippet. MLtable packages your data into a consumable object for training.
166
169
167
170
```yaml
168
171
paths:
@@ -177,10 +180,10 @@ transformations:
177
180
column_type: stream_info
178
181
```
179
182
180
-
You can then pass in the `MLTable` as a [data input for your AutoML training job](./how-to-auto-train-image-models.md#consume-data).
183
+
You can then pass in the `MLTable` as a data input for your AutoML training job. For more information, see [Set up AutoML to train computer vision models](./how-to-auto-train-image-models.md#consume-data).
181
184
182
-
## Next steps
185
+
## Related content
183
186
184
-
* [Train computer vision models with automated machine learning](how-to-auto-train-image-models.md).
185
-
* [Train a small object detection model with automated machine learning](how-to-use-automl-small-object-detect.md).
186
-
* [Tutorial: Train an object detection model (preview) with AutoML and Python](tutorial-auto-train-image-models.md).
187
+
-[Train computer vision models with automated machine learning](how-to-auto-train-image-models.md).
188
+
-[Train a small object detection model with automated machine learning](how-to-use-automl-small-object-detect.md).
189
+
-[Tutorial: Train an object detection model (preview) with AutoML and Python](tutorial-auto-train-image-models.md).
0 commit comments