You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/ai-services/content-safety/concepts/custom-categories.md
+12-10Lines changed: 12 additions & 10 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -8,17 +8,17 @@ manager: nitinme
8
8
ms.service: azure-ai-content-safety
9
9
ms.custom: build-2024
10
10
ms.topic: conceptual
11
-
ms.date: 07/05/2024
11
+
ms.date: 01/22/2025
12
12
ms.author: pafarley
13
13
---
14
14
15
15
# Custom categories (preview)
16
16
17
-
Azure AI Content Safety lets you create and manage your own content moderation categories for enhanced moderation and filtering that matches your specific policies or use cases.
17
+
Azure AI Content Safety lets you create and manage your own content categories for enhanced moderation and filtering that matches your specific policies or use cases.
18
18
19
19
## Types of customization
20
20
21
-
There are multiple ways to define and use custom categories, which are detailed and compared in this section.
21
+
There are multiple methods for defining and using custom categories, detailed and compared in this section.
22
22
23
23
| API | Functionality |
24
24
| :--------- | :------------ |
@@ -39,19 +39,19 @@ The Custom categories (rapid) API is designed to be quicker and more flexible th
39
39
40
40
An incident may involve a set of emerging content patterns (text, image, or other modalities) that violate Microsoft community guidelines or the customers' own policies and expectations. These incidents need to be mitigated quickly and accurately to avoid potential live site issues or harm to users and communities.
41
41
42
-
This implementation works on text content and image content.
42
+
This implementation works on both text content and image content.
43
43
44
44
> [!TIP]
45
-
> One way to deal with emerging content incidents is to use [Blocklists](/azure/ai-services/content-safety/how-to/use-blocklist), but that only allows exact text matching and no image matching. The Custom categories (rapid) API offers the following advanced capabilities:
46
-
- semantic text matching using embedding search with a lightweight classifier
47
-
- image matching with a lightweight object-tracking model and embedding search.
45
+
> Another to deal with emerging content incidents is to use [Blocklists](/azure/ai-services/content-safety/how-to/use-blocklist), but that only allows exact text matching and no image matching. The Custom categories (rapid) API offers the following advanced capabilities:
46
+
> - semantic text matching using embedding search with a lightweight classifier
47
+
> - image matching with a lightweight object-tracking model and embedding search.
The Azure AI Content Safety custom categories feature uses a multi-step process for creating, training, and using custom content classification models. Here's a look at the workflow:
54
+
The Azure AI Content Safety custom categories feature uses a multi-step process for creating, training, and using custom content classification models. Here's the workflow:
55
55
56
56
### Step 1: Definition and setup
57
57
@@ -63,7 +63,7 @@ Then, you collect a balanced dataset with **positive** and (optionally) **negati
63
63
64
64
After you prepare your dataset and define categories, the Azure AI Content Safety service trains a new machine learning model. This model uses your definitions and uploaded dataset to perform data augmentation using a large language model. As a result, the training dataset is made larger and of higher quality. During training, the AI model analyzes the data and learns to differentiate between content that aligns with the specified category and content that does not.
65
65
66
-
### Step 3: Model inferencing
66
+
### Step 3: Model evaluation
67
67
68
68
After training, you need to evaluate the model to ensure it meets your accuracy requirements. Test the model with new content that it hasn't received before. The evaluation phase helps you identify any potential adjustments you need to make deploying the model into a production environment.
69
69
@@ -118,12 +118,14 @@ See the following table for the input limitations of the custom categories (rapi
118
118
| Maximum number of text or image incidents per resource| 100 |
To use these APIs, you must create your Azure AI Content Safety resource in one of the supported regions. See [Region availability](../overview.md#region-availability).
124
126
125
127
126
-
## Next steps
128
+
## Next step
127
129
128
130
Follow a how-to guide to use the Azure AI Content Safety APIs to create custom categories.
Copy file name to clipboardExpand all lines: articles/ai-services/content-safety/concepts/protected-material.md
+4-2Lines changed: 4 additions & 2 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -7,14 +7,16 @@ author: PatrickFarley
7
7
manager: nitinme
8
8
ms.service: azure-ai-content-safety
9
9
ms.topic: conceptual
10
-
ms.date: 06/24/2024
10
+
ms.date: 01/22/2025
11
11
ms.author: pafarley
12
12
keywords:
13
13
---
14
14
15
15
16
16
# Protected material detection
17
17
18
+
The Protected material detection APIs scan the output of large language models to identify and flag known protected material. The APIs are designed to help organizations prevent the generation of content that closely matches copyrighted text or code.
19
+
18
20
The [Protected material text API](../quickstart-protected-material.md) flags known text content (for example, song lyrics, articles, recipes, and selected web content) that might be output by large language models.
19
21
20
22
The [Protected material code API](../quickstart-protected-material-code.md) flags protected code content (from known GitHub repositories, including software libraries, source code, algorithms, and other proprietary programming content) that might be output by large language models.
@@ -107,7 +109,7 @@ Refer to this table for details of the major categories of protected material te
107
109
| Lyrics | Only focuses on issues of copyrighted content around Songs. <br><br> Other harmful or sensitive text is out of scope for this task, unless it intersects Songs IP Copyright harm. | <ul><li>Links to web pages that contain information about songs such as:<ul><li>Lyrics of the songs</li><li>Chords or tabs of the associated music</li><li>Analysis or reviews of the song/music</li></ul></li><li>Links to authorized web pages that contain embedded audio/video players as long as:<ul><li>They have legitimate permissions</li><li>They have licensed music</li><li>They are authorized streaming platforms</li><li>They are official YouTube channels</li></ul></li><li>Short excerpts or snippets from lyrics of the songs as long as:<ul><li>They are relevant to the user's query</li><li>They are not a substantial part of the lyrics</li><li>They are not the entire lyrics</li><li>They are not more than 11 words long</li></ul></li><li>Short excerpts or snippets from chords/tabs of the songs as long as:<ul><li>They are relevant to the user's query</li><li>They are not a substantial part of the chords/tabs</li><li>They are not the entire chords/tabs</li></ul></li><li>Any content from songs that have no IP/Copyright protections:<ul><li>Songs/Lyrics/Chords/Tabs that are in the public domain</li><li>Songs/Lyrics/Chords/Tabs for which Copyright protection has elapsed, been surrendered, or never existed</li></ul></li><li>Rejection or refusal to provide copyrighted content:<ul><li>Changing topic to avoid sharing copyrighted content</li><li>Refusal to share copyrighted content</li><li>Providing nonresponsive information</li></ul></li></ul> | <ul><li>Lyrics of a song<ul><li>Entire lyrics</li><li>Substantial part of the lyrics</li><li>Part of lyrics that contain more than 11 words</li></ul></li><li>Chords or Tabs of a song<ul><li>Entire chords/tabs</li><li>Substantial part of the chords/tabs</li></ul></li><li>Links to webpages that contain embedded audio/video players that:<ul><li>Do not have legitimate permissions</li><li>Do not have licensed music</li><li>Are not authorized streaming platforms</li><li>Are not official YouTube channels</li></ul></li><li>Methods to access copyrighted content:<ul><li>Steps to download songs from an unauthorized website</li><li>Ways to bypass paywalls or DRM protections to access copyrighted songs or videos</li></ul></li></ul> |
108
110
109
111
110
-
## Next steps
112
+
## Next step
111
113
112
114
Follow the quickstart to get started using Azure AI Content Safety to detect protected material.
description: See the possible error codes for the Azure AI Content Safety APIs.
4
+
description: See the possible error codes and their corresponding suggestions for the Azure AI Content Safety APIs.
5
5
#services: cognitive-services
6
6
author: PatrickFarley
7
7
manager: nitinme
8
8
ms.service: azure-ai-content-safety
9
9
ms.custom: build-2023
10
10
ms.topic: conceptual
11
-
ms.date: 03/07/2024
11
+
ms.date: 01/22/2025
12
12
ms.author: pafarley
13
13
---
14
14
15
15
# Azure AI Content Safety error codes
16
16
17
-
The content APIs may return the following error codes:
17
+
The content APIs might return the following error codes:
18
18
19
19
| Error Code | Possible reasons | Suggestions |
20
20
| ---------- | ------- | -------------------- |
21
-
| InvalidRequestBody | One or more fields in the request body do not match the API definition. | Check the API version you specified in the API call. <br/>Check the corresponding API definition for the API version you selected. |
22
-
| InvalidResourceName | The resource name you specified in the URL does not meet the requirements, like the blocklist name, blocklist term ID, etc. | Check the API version you specified in the API call. <br/>Check whether the given name has invalid characters according to the API definition. |
23
-
| ResourceNotFound | The resource you specified in the URL may not exist, like the blocklist name. | Check the API version you specified in the API call. <br/>Double check the existence of the resource specified in the URL. |
24
-
| InternalError | Some unexpected situations on the server side have been triggered. | You might want to retry a few times after a small period and see it the issue happens again. <br/> Contact Azure Support if this issue persists. |
21
+
| InvalidRequestBody | One or more fields in the request body don't match the API definition. | Check the API version you specified in the API call. <br/>Check the corresponding API definition for the API version you selected. |
22
+
| InvalidResourceName | The resource name you specified in the URL doesn't meet the requirements, like the blocklist name, blocklist term ID, etc. | Check the API version you specified in the API call. <br/>Check whether the given name has invalid characters according to the API definition. |
23
+
| ResourceNotFound | The resource you specified in the URL might not exist, like the blocklist name. | Check the API version you specified in the API call. <br/>Double check the existence of the resource specified in the URL. |
24
+
| InternalError | Some unexpected situations on the server side were triggered. | You might want to retry a few times after a small period and see it the issue happens again. <br/> Contact Azure Support if this issue persists. |
25
25
| ServerBusy | The server side cannot process the request temporarily. | You might want to retry a few times after a small period and see it the issue happens again. <br/>Contact Azure Support if this issue persists. |
26
-
| TooManyRequests | The current RPS has exceeded the quota for your current SKU. | Check the pricing table to understand the RPS quota. <br/>Contact Azure Support if you need more QPS. |
26
+
| TooManyRequests | The current requests-per-second has exceeded the quota for your current tier. | Check the pricing table to understand the RPS quota. <br/>Contact Azure Support if you need more QPS. |
27
27
28
28
29
29
## Azure AI Foundry error messages
30
30
31
-
If you encounter the error **Your account does not have access to this resource, please contact your resource owner to get access**, please ensure your account is assigned the role of `Cognitive Services User` for the Content Safety resource or Azure AI Services resource you are using.
31
+
If you encounter the error `Your account does not have access to this resource, please contact your resource owner to get access`, ensure your account is assigned the role of `Cognitive Services User` for the Content Safety resource or Azure AI Services resource you're using.
@@ -19,7 +19,7 @@ Get started with the Content Studio, REST API, or client SDKs to do basic image
19
19
20
20
For more information on image moderation, see the [Harm categories concept page](./concepts/harm-categories.md). For API input limits, see the [Input requirements](./overview.md#input-requirements) section of the Overview.
21
21
22
-
> [!NOTE]
22
+
> [!CAUTION]
23
23
>
24
24
> The sample data and code may contain offensive content. User discretion is advised.
@@ -20,7 +20,7 @@ Get started with the Content Safety Studio, REST API, or client SDKs to do basic
20
20
For more information on text moderation, see the [Harm categories concept page](./concepts/harm-categories.md). For API input limits, see the [Input requirements](./overview.md#input-requirements) section of the Overview.
21
21
22
22
23
-
> [!NOTE]
23
+
> [!CAUTION]
24
24
>
25
25
> The sample data and code may contain offensive content. User discretion is advised.
0 commit comments