Skip to content

Commit 695526f

Browse files
authored
Merge pull request #193844 from magrefaat/patch-87
custom text classification
2 parents 0ce195b + 32cfb2f commit 695526f

21 files changed

+75
-75
lines changed

articles/cognitive-services/language-service/custom-classification/concepts/data-formats.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -1,7 +1,7 @@
11
---
22
title: Custom text classification data formats
33
titleSuffix: Azure Cognitive Services
4-
description: Learn about the data formats accepted by custom entity extraction.
4+
description: Learn about the data formats accepted by custom text classification.
55
services: cognitive-services
66
author: aahill
77
manager: nitinme
@@ -64,7 +64,7 @@ Your tags file should be in the `json` format below.
6464
* `documents`: An array of tagged documents.
6565
* `location`: The path of the file. The file has to be in root of the storage container.
6666
* `language`: Language of the file. Use one of the [supported culture locales](../language-support.md).
67-
* `classifiers`: Array of classifier objects assigned to the file. If you're working on a single classification project, there should be one classifier per file only.
67+
* `classifiers`: Array of classifier objects assigned to the file. If you're working on a single label classification project, there should be one classifier per file only.
6868

6969
## Next steps
7070

articles/cognitive-services/language-service/custom-classification/concepts/evaluation.md

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -1,7 +1,7 @@
11
---
2-
title: Custom classification evaluation metrics
2+
title: Custom text classification evaluation metrics
33
titleSuffix: Azure Cognitive Services
4-
description: Learn about evaluation metrics in custom entity extraction.
4+
description: Learn about evaluation metrics in custom text classification.
55
services: cognitive-services
66
author: aahill
77
manager: nitinme
@@ -104,7 +104,7 @@ So what does it actually mean to have a high precision or a high recall for a ce
104104
| High | Low | The model predicts this class well, however it is with low confidence. This may be because this class is over represented in the dataset so consider balancing your data distribution. |
105105
| Low | Low | This class is poorly handled by the model where it is not usually predicted and when it is, it is not with high confidence. |
106106

107-
Custom classification models are expected to experience both false negatives and false positives. You need to consider how each will affect the overall system, and carefully think through scenarios where the model will ignore correct predictions, and recognize incorrect predictions. Depending on your scenario, either *precision* or *recall* could be more suitable evaluating your model's performance.
107+
Custom text classification models are expected to experience both false negatives and false positives. You need to consider how each will affect the overall system, and carefully think through scenarios where the model will ignore correct predictions, and recognize incorrect predictions. Depending on your scenario, either *precision* or *recall* could be more suitable evaluating your model's performance.
108108

109109
For example, if your scenario involves processing technical support tickets, predicting the wrong class could cause it to be forwarded to the wrong department/team. In this example, you should consider making your system more sensitive to false positives, and precision would be a more relevant metric for evaluation.
110110

articles/cognitive-services/language-service/custom-classification/fail-over.md

Lines changed: 5 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -1,7 +1,7 @@
11
---
2-
title: Back up and recover your custom classification models
2+
title: Back up and recover your custom text classification models
33
titleSuffix: Azure Cognitive Services
4-
description: Learn how to save and recover your custom classification models.
4+
description: Learn how to save and recover your custom text classification models.
55
services: cognitive-services
66
author: aahill
77
manager: nitinme
@@ -17,7 +17,7 @@ ms.custom: language-service-custom-classification
1717

1818
When you create a Language resource, you specify a region for it to be created in. From then on, your resource and all of the operations related to it take place in the specified Azure server region. It's rare, but not impossible, to encounter a network issue that hits an entire region. If your solution needs to always be available, then you should design it to either fail-over into another region. This requires two Azure Language resources in different regions and the ability to sync custom models across regions.
1919

20-
If your app or business depends on the use of a custom classification model, we recommend that you create a replica of your project into another supported region. So that if a regional outage occurs, you can then access your model in the other fail-over region where you replicated your project.
20+
If your app or business depends on the use of a custom text classification model, we recommend that you create a replica of your project into another supported region. So that if a regional outage occurs, you can then access your model in the other fail-over region where you replicated your project.
2121

2222
Replicating a project means that you export your project metadata and assets and import them into a new project. This only makes a copy of your project settings and tagged data. You still need to [train](./how-to/train-model.md) and [deploy](how-to/call-api.md#deploy-your-model) the models to be available for use with [prediction APIs](https://aka.ms/ct-runtime-swagger).
2323

@@ -132,7 +132,7 @@ Use the url from the `resultUrl` key in the body to view the exported assets fro
132132

133133
### Get export results
134134

135-
Submit a **GET** request using the `{RESULT-URL}` you recieved from the previous step to view the results of the export job.
135+
Submit a **GET** request using the `{RESULT-URL}` you received from the previous step to view the results of the export job.
136136

137137
#### Headers
138138

@@ -330,7 +330,7 @@ Use the following header to authenticate your request.
330330

331331
## Deploy your model
332332

333-
This is te step where you make your trained model available form consumption via the [runtime prediction API](https://aka.ms/ct-runtime-swagger).
333+
This is the step where you make your trained model available form consumption via the [runtime prediction API](https://aka.ms/ct-runtime-swagger).
334334

335335
> [!TIP]
336336
> Use the same deployment name as your primary project for easier maintenance and minimal changes to your system to handle redirecting your traffic.

articles/cognitive-services/language-service/custom-classification/faq.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -87,9 +87,9 @@ After deploying your model, you [call the prediction API](how-to/call-api.md), u
8787

8888
## Data privacy and security
8989

90-
Custom text classification is a data processor for General Data Protection Regulation (GDPR) purposes. In compliance with GDPR policies, Custom classification users have full control to view, export, or delete any user content either through the [Language Studio](https://aka.ms/languageStudio) or programmatically by using [REST APIs](https://aka.ms/ct-authoring-swagger).
90+
Custom text classification is a data processor for General Data Protection Regulation (GDPR) purposes. In compliance with GDPR policies, custom text classification users have full control to view, export, or delete any user content either through the [Language Studio](https://aka.ms/languageStudio) or programmatically by using [REST APIs](https://aka.ms/ct-authoring-swagger).
9191

92-
Your data is only stored in your Azure Storage account. Custom classification only has access to read from it during training.
92+
Your data is only stored in your Azure Storage account. Custom text classification only has access to read from it during training.
9393

9494
## How to clone my project?
9595

articles/cognitive-services/language-service/custom-classification/how-to/call-api.md

Lines changed: 5 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -1,5 +1,5 @@
11
---
2-
title: How to submit custom classification tasks
2+
title: How to submit custom text classification tasks
33
titleSuffix: Azure Cognitive Services
44
description: Learn about sending a request for custom text classification.
55
services: cognitive-services
@@ -19,7 +19,7 @@ After you're satisfied with your model, and made any necessary improvements, you
1919

2020
## Prerequisites
2121

22-
* [A custom classification project](create-project.md) with a configured Azure blob storage account,
22+
* [A custom text classification project](create-project.md) with a configured Azure blob storage account,
2323
* Text data that has [been uploaded](create-project.md#prepare-training-data) to your storage account.
2424
* [Tagged data](tag-data.md) and successfully [trained model](train-model.md)
2525
* Reviewed the [model evaluation details](view-model-evaluation.md) to determine how your model is performing.
@@ -86,7 +86,7 @@ First you will need to get your resource key and endpoint
8686

8787
:::image type="content" source="../media/get-endpoint-azure.png" alt-text="Get the Azure endpoint" lightbox="../media/get-endpoint-azure.png":::
8888

89-
### Submit text classification task
89+
### Submit a custom text classification task
9090

9191
1. Start constructing a POST request by updating the following URL with your endpoint.
9292

@@ -97,7 +97,7 @@ First you will need to get your resource key and endpoint
9797
3. In the JSON body of your request, you will specify The documents you're inputting for analysis, and the parameters for the custom entity recognition task. `project-name` is case-sensitive.
9898

9999
> [!tip]
100-
> See the [quickstart article](../quickstart.md?pivots=rest-api#submit-text-classification-task) and [reference documentation](https://westus2.dev.cognitive.microsoft.com/docs/services/TextAnalytics-v3-2-Preview-2/operations/Analyze) for more information about the JSON syntax.
100+
> See the [quickstart article](../quickstart.md?pivots=rest-api#submit-a-custom-text-classification-task) and [reference documentation](https://westus2.dev.cognitive.microsoft.com/docs/services/TextAnalytics-v3-2-Preview-2/operations/Analyze) for more information about the JSON syntax.
101101
102102
```json
103103
{
@@ -166,7 +166,7 @@ First you will need to get your resource key and endpoint
166166
* [JavaScript](https://github.com/Azure/azure-sdk-for-js/blob/main/sdk/textanalytics/ai-text-analytics/samples/v5/javascript/customText.js)
167167
* [Python](https://github.com/Azure/azure-sdk-for-python/blob/main/sdk/textanalytics/azure-ai-textanalytics/samples/sample_single_category_classify.py)
168168

169-
Multiple label classification:
169+
Multi label classification:
170170
* [C#](https://github.com/Azure/azure-sdk-for-net/blob/main/sdk/textanalytics/Azure.AI.TextAnalytics/samples/Sample11_MultiCategoryClassify.md)
171171
* [Java](https://github.com/Azure/azure-sdk-for-java/blob/main/sdk/textanalytics/azure-ai-textanalytics/src/samples/java/com/azure/ai/textanalytics/lro/ClassifyDocumentMultiCategory.java)
172172
* [JavaScript](https://github.com/Azure/azure-sdk-for-js/blob/main/sdk/textanalytics/ai-text-analytics/samples/v5/javascript/customText.js)

articles/cognitive-services/language-service/custom-classification/how-to/create-project.md

Lines changed: 5 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -1,7 +1,7 @@
11
---
22
title: How to create custom text classification projects
33
titleSuffix: Azure Cognitive Services
4-
description: Learn about the steps for using Azure resources with custom classification.
4+
description: Learn about the steps for using Azure resources with custom text classification.
55
services: cognitive-services
66
author: aahill
77
manager: nitinme
@@ -28,7 +28,7 @@ Before you start using custom text classification, you will need several things:
2828

2929
## Azure resources
3030

31-
Before you start using custom classification, you will need an Azure Language resource. We recommend following the steps below for creating your resource in the Azure portal. Creating a resource in the Azure portal lets you create an Azure storage account at the same time, with all of the required permissions pre-configured. You can also read further in the article to learn how to use a pre-existing resource, and configure it to work with custom text classification.
31+
Before you start using custom text classification, you will need an Azure Language resource. We recommend following the steps below for creating your resource in the Azure portal. Creating a resource in the Azure portal lets you create an Azure storage account at the same time, with all of the required permissions pre-configured. You can also read further in the article to learn how to use a pre-existing resource, and configure it to work with custom text classification.
3232

3333
You also will need an Azure storage account where you will upload your `.txt` files that will be used to train a model to classify text.
3434

@@ -45,12 +45,12 @@ You also will need an Azure storage account where you will upload your `.txt` fi
4545
If it's your first time logging in, you'll see a window in [Language Studio](https://aka.ms/languageStudio) that will let you choose a language resource or create a new one. You can also create a resource by clicking the settings icon in the top-right corner, selecting **Resources**, then clicking **Create a new resource**.
4646

4747
> [!IMPORTANT]
48-
> * To use Custom Text Classification, you'll need a Language resource in **West US 2** or **West Europe** with the Standard (**S**) pricing tier.
48+
> * To use custom text classification, you'll need a Language resource in **West US 2** or **West Europe** with the Standard (**S**) pricing tier.
4949
> * Be sure to to select **Managed Identity** when you create a resource.
5050
5151
:::image type="content" source="../../media/create-new-resource-small.png" alt-text="A screenshot showing the resource creation screen in Language Studio." lightbox="../../media/create-new-resource.png":::
5252

53-
To use custom classification, you'll need to [create an Azure storage account](../../../../storage/common/storage-account-create.md) if you don't have one already.
53+
To use custom text classification, you'll need to [create an Azure storage account](../../../../storage/common/storage-account-create.md) if you don't have one already.
5454

5555
Next you'll need to assign the [correct roles](#roles-for-your-storage-account) for the storage account to connect it to your Language resource.
5656

@@ -95,7 +95,7 @@ You can use an existing Language resource to get started with custom text classi
9595
|Pricing tier | Make sure your existing resource is in the Standard (**S**) pricing tier. Only this pricing tier is supported. If your resource doesn't use this pricing tier, you will need to create a new resource. |
9696
|Managed identity | Make sure that the resource-managed identity setting is enabled. Otherwise, read the next section. |
9797

98-
To use custom classification, you'll need to [create an Azure storage account](../../../../storage/common/storage-account-create.md) if you don't have one already.
98+
To use custom text classification, you'll need to [create an Azure storage account](../../../../storage/common/storage-account-create.md) if you don't have one already.
9999

100100
Next you'll need to assign the [correct roles](#roles-for-your-storage-account) for the storage account to connect it to your Language resource.
101101

articles/cognitive-services/language-service/custom-classification/how-to/design-schema.md

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -1,7 +1,7 @@
11
---
22
title: How to prepare data and define a schema
33
titleSuffix: Azure Cognitive Services
4-
description: Learn about data selection, preparation, and creating a schema for custom classification projects.
4+
description: Learn about data selection, preparation, and creating a schema for custom text classification projects.
55
services: cognitive-services
66
author: aahill
77
manager: nitinme
@@ -15,7 +15,7 @@ ms.custom: language-service-custom-classification, ignite-fall-2021
1515

1616
# How to prepare data and define a schema
1717

18-
In order to create a custom classification model, you will need quality data to train it. This article covers how you should approach selecting and preparing your data, along with defining a schema. A schema defines the classes that you need your model to classify your text into at runtime, and is the first step of [developing a custom classification application](../overview.md#project-development-lifecycle).
18+
In order to create a custom text classification model, you will need quality data to train it. This article covers how you should approach selecting and preparing your data, along with defining a schema. A schema defines the classes that you need your model to classify your text into at runtime, and is the first step of [developing a custom classification application](../overview.md#project-development-lifecycle).
1919

2020

2121
## Data selection
@@ -62,4 +62,4 @@ The schema defines the classes that you need your model to classify your text in
6262

6363
## Next steps
6464

65-
If you haven't already, create a custom classification project. If it's your first time using custom classification, consider following the [quickstart](../quickstart.md) to create an example project. You can also see the [project requirements](../how-to/create-project.md) for more details on what you need to create a project.
65+
If you haven't already, create a custom text classification project. If it's your first time using custom text classification, consider following the [quickstart](../quickstart.md) to create an example project. You can also see the [project requirements](../how-to/create-project.md) for more details on what you need to create a project.

articles/cognitive-services/language-service/custom-classification/how-to/improve-model.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -21,7 +21,7 @@ After you've trained your model you reviewed its evaluation details, you can dec
2121

2222
To optionally improve a model, you will need to have:
2323

24-
* [A custom classification project](create-project.md) with a configured Azure blob storage account,
24+
* [A custom text classification project](create-project.md) with a configured Azure blob storage account,
2525
* Text data that has [been uploaded](create-project.md#prepare-training-data) to your storage account.
2626
* [Tagged data](tag-data.md) to successfully [train a model](train-model.md)
2727
* Reviewed the [model evaluation details](view-model-evaluation.md) to determine how your model is performing.

articles/cognitive-services/language-service/custom-classification/how-to/tag-data.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -61,9 +61,9 @@ Use the following steps to tag your data
6161

6262
:::image type="content" source="../media/tag-single.png" alt-text="A screenshot showing the single label classification menu" lightbox="../media/tag-single.png":::
6363

64-
* **Multiple label classification**: your file can be tagged with multiple classes, you can do so by checking all applicable check boxes next to the classes you want to tag this file with.
64+
* **Multi label classification**: your file can be tagged with multiple classes, you can do so by checking all applicable check boxes next to the classes you want to tag this file with.
6565

66-
:::image type="content" source="../media/tag-multi.png" alt-text="A screenshot showing the multiple label classification menu" lightbox="../media/tag-multi.png":::
66+
:::image type="content" source="../media/tag-multi.png" alt-text="A screenshot showing the multi label classification menu" lightbox="../media/tag-multi.png":::
6767

6868
While tagging, your changes will be synced periodically, if they have not been saved yet you will find a warning at the top of your page. If you want to save manually, click on Save tags button at the top of the page.
6969

articles/cognitive-services/language-service/custom-classification/how-to/train-model.md

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -1,5 +1,5 @@
11
---
2-
title: How to train your custom classification model - Azure Cognitive Services
2+
title: How to train your custom text classification model - Azure Cognitive Services
33
titleSuffix: Azure Cognitive Services
44
description: Learn about how to train your model for custom text classification.
55
services: cognitive-services
@@ -13,7 +13,7 @@ ms.author: aahi
1313
ms.custom: language-service-custom-classification, ignite-fall-2021
1414
---
1515

16-
# How to train a text classification model
16+
# How to train a custom text classification model
1717

1818

1919
Training is the process where the model learns from your [tagged data](tag-data.md). After training is completed, you will be able to [use the model evaluation metrics](../how-to/view-model-evaluation.md) to determine if you need to [improve your model](../how-to/improve-model.md).
@@ -30,7 +30,7 @@ See the [application development lifecycle](../overview.md#project-development-l
3030

3131
## Data split
3232

33-
Before starting the training process, files in your dataset are divided into three groups at random:
33+
Before you start the training process, files in your dataset are divided into three groups at random:
3434

3535
* The **training set** contains 80% of the files in your dataset. It is the main set that is used to train the model.
3636

0 commit comments

Comments
 (0)