You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/machine-learning/service/how-to-create-labeling-projects.md
+3-3Lines changed: 3 additions & 3 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -14,7 +14,7 @@ ms.date: 11/04/2019
14
14
15
15
Labeling large amounts of data has often been a headache in machine learning projects. ML projects with a computer vision component, such as image classification or object detection, generally require thousands of images and corresponding labels.
16
16
17
-
Azure Machine Learning studio gives you a central location to create, manage, and monitor labeling projects. Labeling projects help coordinate the data, labels, and team members, allowing you to more efficiently manage the labeling tasks. Currently supported tasks are image classification, either multi-label or multi-class, and object identification using bounded boxes.
17
+
Azure Machine Learning gives you a central location to create, manage, and monitor labeling projects. Labeling projects help coordinate the data, labels, and team members, allowing you to more efficiently manage the labeling tasks. Currently supported tasks are image classification, either multi-label or multi-class, and object identification using bounded boxes.
18
18
19
19
Azure tracks progress and maintains the queue of incomplete labeling tasks. Labelers don't require an Azure account to participate. Once authenticated with their Microsoft Account (MSA) or [Azure Active Directory](https://docs.microsoft.com/azure/active-directory/active-directory-whatis), they can do as much or as little labeling as their time allows. They can assign and change labels using keyboard shortcuts.
20
20
@@ -39,7 +39,7 @@ In this article, you'll learn how to:
39
39
40
40
## Create a labeling project
41
41
42
-
Labeling projects are administered from [Azure Machine Learning studio](https://ml.azure.com/). The **Labeling projects** page allows you to manage your projects, teams, and people. A project has one or more teams assigned to it, and a team has one or more people assigned to it.
42
+
Labeling projects are administered from [Azure Machine Learning](https://ml.azure.com/). The **Labeling projects** page allows you to manage your projects, teams, and people. A project has one or more teams assigned to it, and a team has one or more people assigned to it.
43
43
44
44
If your data are already stored in Azure blob storage, you should make them available as a datastore before creating your labeling project. For information, see [Create and register datastores](https://docs.microsoft.com/azure/machine-learning/service/how-to-access-data#create-and-register-datastores).
45
45
@@ -145,7 +145,7 @@ You can label data directly from the **Project details** page by selecting **Lab
145
145
146
146
At any time, you may export the label data for machine learning experimentation. Image labels can be exported in [COCO format](http://cocodataset.org/#format-data) or as an Azure ML dataset. You will find the **Export** button on the **Project details** page of your labeling project.
147
147
148
-
The COCO file is created in the default blob store of the Azure ML workspace in a folder within **export/coco**. You can access the exported Azure ML dataset under the **Datasets** section of studio. Dataset details page also provides sample code to access your labels from Python.
148
+
The COCO file is created in the default blob store of the Azure ML workspace in a folder within **export/coco**. You can access the exported Azure ML dataset under the **Datasets** section of Azure Machine Learning. Dataset details page also provides sample code to access your labels from Python.
In this article, you learn how to collect data from and monitor models deployed to web service endpoints in Azure Kubernetes Service (AKS) or Azure Container Instances (ACI) by enabling Azure Application Insights. In addition to collecting an endpoint's input data and response, you can monitor:
20
-
* Request rates, response times, and failure rates.
21
-
* Dependency rates, response times, and failure rates.
22
-
* Exceptions.
20
+
21
+
* Request rates, response times, and failure rates
22
+
* Dependency rates, response times, and failure rates
23
+
* Exceptions
23
24
24
25
[Learn more about Azure Application Insights](../../azure-monitor/app/app-insights-overview.md).
25
26
26
27
27
28
## Prerequisites
28
29
29
-
* If you don’t have an Azure subscription, create a free account before you begin. Try the [free or paid version of Azure Machine Learning](https://aka.ms/AMLFree) today.
30
+
* If you don’t have an Azure subscription, create a free account before you begin. Try the [free or paid version of Azure Machine Learning](https://aka.ms/AMLFree) today
30
31
31
-
* An Azure Machine Learning workspace, a local directory that contains your scripts, and the Azure Machine Learning SDK for Python installed. To learn how to get these prerequisites, see [How to configure a development environment](how-to-configure-environment.md).
32
-
* A trained machine learning model to be deployed to Azure Kubernetes Service (AKS) or Azure Container Instance (ACI). If you don't have one, see the [Train image classification model](tutorial-train-models-with-aml.md) tutorial.
32
+
* An Azure Machine Learning workspace, a local directory that contains your scripts, and the Azure Machine Learning SDK for Python installed. To learn how to get these prerequisites, see [How to configure a development environment](how-to-configure-environment.md)
33
+
* A trained machine learning model to be deployed to Azure Kubernetes Service (AKS) or Azure Container Instance (ACI). If you don't have one, see the [Train image classification model](tutorial-train-models-with-aml.md) tutorial
33
34
34
35
## Web service input and response data
35
36
@@ -39,65 +40,68 @@ The input and response to the service - corresponding to the inputs to the ML mo
39
40
40
41
You can enable and disable Azure Application Insights in the Azure portal.
41
42
42
-
1. In the [Azure portal](https://portal.azure.com), open your workspace.
43
+
1. In the [Azure portal](https://portal.azure.com), open your workspace
43
44
44
-
1. On the **Deployments** tab, select the service where you want to enable Azure Application Insights.
45
+
1. On the **Deployments** tab, select the service where you want to enable Azure Application Insights
45
46
46
47
[](./media/how-to-enable-app-insights/Deployments.PNG#lightbox)
4. In **Advanced Settings**, select the **Enable AppInsights diagnostics** check box.
53
+
4. In **Advanced Settings**, select the **Enable AppInsights diagnostics** check box
53
54
54
55
[](./media/how-to-enable-app-insights/AdvancedSettings.png#lightbox)
55
56
56
-
1. Select **Update** at the bottom of the screen to apply the changes.
57
+
1. Select **Update** at the bottom of the screen to apply the changes
57
58
58
59
### Disable
59
-
1. In the [Azure portal](https://portal.azure.com), open your workspace.
60
-
1. Select **Deployments**, select the service, and then select **Edit**.
60
+
61
+
1. In the [Azure portal](https://portal.azure.com), open your workspace
62
+
1. Select **Deployments**, select the service, and then select **Edit**
61
63
62
64
[](./media/how-to-enable-app-insights/Edit.PNG#lightbox)
63
65
64
-
1. In **Advanced Settings**, clear the **Enable AppInsights diagnostics** check box.
66
+
1. In **Advanced Settings**, clear the **Enable AppInsights diagnostics** check box
65
67
66
68
[](./media/how-to-enable-app-insights/uncheck.png#lightbox)
67
69
68
-
1. Select **Update** at the bottom of the screen to apply the changes.
70
+
1. Select **Update** at the bottom of the screen to apply the changes
69
71
70
72
## Use Python SDK to configure
71
73
72
74
### Update a deployed service
73
-
1. Identify the service in your workspace. The value for `ws` is the name of your workspace.
75
+
76
+
1. Identify the service in your workspace. The value for `ws` is the name of your workspace
74
77
75
78
```python
76
79
from azureml.core.webservice import Webservice
77
80
aks_service= Webservice(ws, "my-service-name")
78
81
```
79
-
2. Update your service and enable Azure Application Insights.
82
+
2. Update your service and enable Azure Application Insights
80
83
81
84
```python
82
85
aks_service.update(enable_app_insights=True)
83
86
```
84
87
85
88
### Log custom traces in your service
89
+
86
90
If you want to log custom traces, follow the standard deployment process forAKSorACIin the [How to deploy and where](how-to-deploy-and-where.md) document. Then use the following steps:
87
91
88
-
1. Update the scoring file by adding print statements.
92
+
1. Update the scoring file by adding print statements
1. To look into your web service input and response payloads, select **Analytics**
123
-
1. In the schema section, select **Traces** and filter down traces with the message `"model_data_collection"`. In the custom dimensions, you can see the inputs, predictions, and other relevant details.
128
+
1. In the schema section, select **Traces** and filter down traces with the message `"model_data_collection"`. In the custom dimensions, you can see the inputs, predictions, and other relevant details
3. To look into your custom traces, select **Analytics**.
129
-
4. In the schema section, select **Traces**. Then select **Run** to run your query. Data should appear in a table format and should map to your custom calls in your scoring file.
133
+
3. To look into your custom traces, select **Analytics**
134
+
4. In the schema section, select **Traces**. Then select **Run** to run your query. Data should appear in a table format and should map to your custom calls in your scoring file
@@ -147,5 +152,5 @@ The [enable-app-insights-in-production-service.ipynb](https://github.com/Azure/M
147
152
148
153
## Next steps
149
154
150
-
* See [how to deploy a model to an Azure Kubernetes Service cluster](https://docs.microsoft.com/azure/machine-learning/service/how-to-deploy-azure-kubernetes-service) or [how to deploy a model to Azure Container Instances](https://docs.microsoft.com/azure/machine-learning/service/how-to-deploy-azure-container-instance) to deploy your models to web service endpoints, and enable Azure Application Insights to leverage data collection and endpoint monitoring.
151
-
* See [MLOps: Manage, deploy, and monitor models with Azure Machine Learning](https://docs.microsoft.com/azure/machine-learning/service/concept-model-management-and-deployment) to learn more about leveraging data collected from models in production. Such data can help to continually improve your machine learning process.
155
+
* See [how to deploy a model to an Azure Kubernetes Service cluster](https://docs.microsoft.com/azure/machine-learning/service/how-to-deploy-azure-kubernetes-service) or [how to deploy a model to Azure Container Instances](https://docs.microsoft.com/azure/machine-learning/service/how-to-deploy-azure-container-instance) to deploy your models to web service endpoints, and enable Azure Application Insights to leverage data collection and endpoint monitoring
156
+
* See [MLOps: Manage, deploy, and monitor models with Azure Machine Learning](https://docs.microsoft.com/azure/machine-learning/service/concept-model-management-and-deployment) to learn more about leveraging data collected from models in production. Such data can help to continually improve your machine learning process
0 commit comments