Skip to content

Commit 3e28be3

Browse files
authored
Merge pull request #111672 from sdgilley/patch-42
update for object detection
2 parents 104e10a + f968b83 commit 3e28be3

File tree

2 files changed

+7
-5
lines changed

2 files changed

+7
-5
lines changed

articles/machine-learning/how-to-create-labeling-projects.md

Lines changed: 4 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -134,8 +134,6 @@ For bounding boxes, important questions include:
134134

135135
The **ML assisted labeling** page lets you trigger automatic machine learning models to accelerate the labeling task. At the beginning of your labeling project, the images are shuffled into a random order to reduce potential bias. However, any biases that are present in the dataset will be reflected in the trained model. For example, if 80% of your images are of a single class, then approximately 80% of the data used to train the model will be of that class. This training does not include active learning.
136136

137-
This feature is available for image classification (multi-class or multi-label) tasks.
138-
139137
Select *Enable ML assisted labeling* and specify a GPU to enable assisted labeling, which consists of two phases:
140138
* Clustering
141139
* Prelabeling
@@ -146,13 +144,15 @@ Since the final labels still rely on input from the labeler, this technology is
146144

147145
### Clustering
148146

149-
After a certain number of labels are submitted, the machine learning model starts to group together similar images. These similar images are presented to the labelers on the same screen to speed up manual tagging. Clustering is especially useful when the labeler is viewing a grid of 4, 6, or 9 images.
147+
After a certain number of labels are submitted, the machine learning model for image classification starts to group together similar images. These similar images are presented to the labelers on the same screen to speed up manual tagging. Clustering is especially useful when the labeler is viewing a grid of 4, 6, or 9 images.
150148

151149
Once a machine learning model has been trained on your manually labeled data, the model is truncated to its last fully-connected layer. Unlabeled images are then passed through the truncated model in a process commonly known as "embedding" or "featurization." This embeds each image in a high-dimensional space defined by this model layer. Images which are nearest neighbors in the space are used for clustering tasks.
152150

151+
The clustering phase does not appear for object detection models.
152+
153153
### Prelabeling
154154

155-
After more image labels are submitted, a classification model is used to predict image tags. The labeler now sees pages that contain predicted labels already present on each image. The task is then to review these labels and correct any mis-labeled images before submitting the page.
155+
After enough image labels are submitted, a classification model is used to predict image tags. Or an object detection model is used to predict bounding boxes. The labeler now sees pages that contain predicted labels already present on each image. For object detection, predicted boxes are also shown. The task is then to review these predictions and correct any mis-labeled images before submitting the page.
156156

157157
Once a machine learning model has been trained on your manually labeled data, the model is evaluated on a test set of manually labeled images to determine its accuracy at a variety of different confidence thresholds. This evaluation process is used to determine a confidence threshold above which the model is accurate enough to show pre-labels. The model is then evaluated against unlabeled data. Images with predictions more confident than this threshold are used for pre-labeling.
158158

articles/machine-learning/how-to-label-images.md

Lines changed: 3 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -61,12 +61,14 @@ After you submit tags for the data at hand, Azure refreshes the page with a new
6161

6262
### Assisted machine learning
6363

64-
Machine learning algorithms may be triggered during a multi-class or multi-label classification task. If these algorithms are enabled in your project, you may see the following:
64+
Machine learning algorithms may be triggered. If these algorithms are enabled in your project, you may see the following:
6565

6666
* After some amount of images have been labeled, you may see **Tasks clustered** at the top of your screen next to the project name. This means that images are grouped together to present similar images on the same page. If so, switch to one of the multiple image views to take advantage of the grouping.
6767

6868
* At a later point, you may see **Tasks prelabeled** next to the project name. Images will then appear with a suggested label that comes from a machine learning classification model. No machine learning model has 100% accuracy. While we only use images for which the model is confident, these images might still be incorrectly prelabeled. When you see these labels, correct any wrong labels before submitting the page.
6969

70+
* For object detection models, you may see bounding boxes and labels already present. Correct any that are incorrect before submitting the page.
71+
7072
Especially early in a labeling project, the machine learning model may only be accurate enough to prelabel a small subset of images. Once these images are labeled, the labeling project will return to manual labeling to gather more data for the next round of model training. Over time, the model will become more confident about a higher proportion of images, resulting in more prelabel tasks later in the project.
7173

7274
## Tag images for multi-class classification

0 commit comments

Comments
 (0)