Skip to content

Commit 6964b1a

Browse files
authored
Merge pull request #277079 from PatrickFarley/content-safety-updates
[Azure AI Svcs] Content safety updates
2 parents 66ff2f7 + 49f99ae commit 6964b1a

File tree

3 files changed

+41
-34
lines changed

3 files changed

+41
-34
lines changed

articles/ai-services/content-safety/language-support.md

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -14,7 +14,8 @@ ms.author: pafarley
1414

1515
# Language support for Azure AI Content Safety
1616

17-
Some capabilities of Azure AI Content Safety support multiple languages; any capabilities not listed here only support English.
17+
> [!IMPORTANT]
18+
> Azure AI Content Safety features not listed in this article, such as Prompt Shields, Protected material detection, Groundedness detection, and Custom categories (rapid) only support English.
1819
1920
## Text moderation
2021

articles/ai-services/content-safety/overview.md

Lines changed: 31 additions & 24 deletions
Original file line numberDiff line numberDiff line change
@@ -45,12 +45,13 @@ There are different types of analysis available from this service. The following
4545

4646
| Type | Functionality |
4747
| :-------------------------- | :---------------------- |
48-
| [Analyze text](/rest/api/cognitiveservices/contentsafety/text-operations/analyze-text) API | Scans text for sexual content, violence, hate, and self harm with multi-severity levels. |
49-
| [Analyze image](/rest/api/cognitiveservices/contentsafety/image-operations/analyze-image) API | Scans images for sexual content, violence, hate, and self harm with multi-severity levels. |
5048
| [Prompt Shields](/rest/api/cognitiveservices/contentsafety/text-operations/detect-text-jailbreak) (preview) | Scans text for the risk of a [User input attack](./concepts/jailbreak-detection.md) on a Large Language Model. [Quickstart](./quickstart-jailbreak.md) |
5149
| [Groundedness detection](/rest/api/cognitiveservices/contentsafety/text-groundedness-detection-operations/detect-groundedness-options) (preview) | Detects whether the text responses of large language models (LLMs) are grounded in the source materials provided by the users. [Quickstart](./quickstart-groundedness.md) |
5250
| [Protected material text detection](/rest/api/cognitiveservices/contentsafety/text-operations/detect-text-protected-material) (preview) | Scans AI-generated text for known text content (for example, song lyrics, articles, recipes, selected web content). [Quickstart](./quickstart-protected-material.md)|
5351
| Custom categories (rapid) API (preview) | Lets you define [emerging harmful content patterns](./concepts/custom-categories-rapid.md) and scan text and images for matches. [How-to guide](./how-to/custom-categories-rapid.md) |
52+
| [Analyze text](/rest/api/cognitiveservices/contentsafety/text-operations/analyze-text) API | Scans text for sexual content, violence, hate, and self harm with multi-severity levels. |
53+
| [Analyze image](/rest/api/cognitiveservices/contentsafety/image-operations/analyze-image) API | Scans images for sexual content, violence, hate, and self harm with multi-severity levels. |
54+
5455

5556
## Content Safety Studio
5657

@@ -98,9 +99,29 @@ Currently, Azure AI Content Safety has an **F0 and S0** pricing tier. See the Az
9899

99100
### Input requirements
100101

101-
The default maximum length for text submissions is 10K characters. If you need to analyze longer blocks of text, you can split the input text (for example, by punctuation or spacing) across multiple related submissions.
102+
See the following list for the input requirements for each feature.
103+
104+
<!--
105+
| | Analyze text API | Analyze image API | Prompt Shields<br>(preview) | Groundedness<br>detection (preview) | Protected material<br>detection (preview) |
106+
|-------|---|----------|----------|-----|-----|
107+
| Input requirements: | Default maximum length: 10K characters (split longer texts as needed). | Maximum image file size: 4 MB<br>Dimensions between 50x50 and 2048x2048 pixels.<br>Images can be in JPEG, PNG, GIF, BMP, TIFF, or WEBP formats. | Maximum prompt length: 10K characters.<br>Up to five documents with a total of 10D characters. | Maximum 55,000 characters for grounding sources per API call.<br>Maximum text and query length: 7,500 characters. | Default maximum: 1K characters.<br>Minimum: 111 characters (for scanning LLM completions, not user prompts). | -->
108+
109+
- **Analyze text API**:
110+
- Default maximum length: 10K characters (split longer texts as needed).
111+
- **Analyze image API**:
112+
- Maximum image file size: 4 MB
113+
- Dimensions between 50 x 50 and 2048 x 2048 pixels.
114+
- Images can be in JPEG, PNG, GIF, BMP, TIFF, or WEBP formats.
115+
- **Prompt Shields (preview)**:
116+
- Maximum prompt length: 10K characters.
117+
- Up to five documents with a total of 10K characters.
118+
- **Groundedness detection (preview)**:
119+
- Maximum length for grounding sources: 55,000 characters (per API call).
120+
- Maximum text and query length: 7,500 characters.
121+
- **Protected material detection (preview)**:
122+
- Default maximum length: 1K characters.
123+
- Minimum length: 111 characters (for scanning LLM completions, not user prompts).
102124

103-
The maximum size for image submissions is 4 MB, and image dimensions must be between 50 x 50 pixels and 2,048 x 2,048 pixels. Images can be in JPEG, PNG, GIF, BMP, TIFF, or WEBP formats.
104125

105126
### Language support
106127

@@ -112,7 +133,7 @@ For more information, see [Language support](/azure/ai-services/content-safety/l
112133

113134
To use the Content Safety APIs, you must create your Azure AI Content Safety resource in the supported regions. Currently, the Content Safety features are available in the following Azure regions:
114135

115-
|Region | Moderation APIs | Prompt Shields | Protected material<br>detection | Groundedness<br>detection | Incident response | Blocklists |
136+
|Region | Moderation APIs | Prompt Shields<br>(preview) | Protected material<br>detection (preview) | Groundedness<br>detection (preview) | Custom categories<br>(rapid) (preview) | Blocklists |
116137
|---|---|---|---|---|---|---|
117138
| East US |||||||
118139
| East US 2 || | || ||
@@ -134,26 +155,12 @@ Feel free to [contact us](mailto:[email protected]) if you need
134155

135156
### Query rates
136157

137-
#### Moderation APIs
138-
139-
| Pricing Tier | Requests per 10 seconds |
140-
| :----------- | :--------------------- |
141-
| F0 | 1000 |
142-
| S0 | 1000 |
143-
144-
145-
#### Prompt Shields
146-
| Pricing Tier | Requests per 10 seconds |
147-
| :----------- | :---------------------------- |
148-
| F0 | 1000 |
149-
| S0 | 1000 |
150-
151-
#### Groundedness detection
152-
| Pricing Tier | Requests per 10 seconds |
153-
| :----------- | :--------------------------- |
154-
| F0 | 50 |
155-
| S0 | 50 |
158+
Content Safety features have query rate limits in requests-per-10-seconds. See the following table for the rate limits for each feature.
156159

160+
|Pricing tier | Moderation APIs | Prompt Shields<br>(preview) | Protected material<br>detection (preview) | Groundedness<br>detection (preview) | Custom categories<br>(rapid) (preview) |
161+
|--------|---------|-------------|---------|---------|---------|
162+
| F0 | 1000 | 1000 | 1000 | 50 | 1000 |
163+
| S0 | 1000 | 1000 | 1000 | 50 | 1000 |
157164

158165
If you need a faster rate, please [contact us](mailto:[email protected]) to request.
159166

articles/ai-services/content-safety/toc.yml

Lines changed: 8 additions & 9 deletions
Original file line numberDiff line numberDiff line change
@@ -17,19 +17,18 @@ items:
1717
href: faq.yml
1818
- name: Quickstarts
1919
items:
20-
- name: Content Safety Studio
21-
href: studio-quickstart.md
22-
- name: Text moderation
23-
href: quickstart-text.md
24-
- name: Image moderation
25-
href: quickstart-image.md
2620
- name: Prompt Shields (preview)
2721
href: quickstart-jailbreak.md
2822
- name: Groundedness detection (preview)
2923
href: quickstart-groundedness.md
3024
- name: Protected material detection (preview)
3125
href: quickstart-protected-material.md
32-
26+
- name: Content Safety Studio
27+
href: studio-quickstart.md
28+
- name: Text moderation
29+
href: quickstart-text.md
30+
- name: Image moderation
31+
href: quickstart-image.md
3332
- name: Samples
3433
items:
3534
- name: Azure AI Content Safety Python samples
@@ -58,14 +57,14 @@ items:
5857
href: ../cognitive-services-virtual-networks.md?context=/azure/ai-services/content-safety/context/context
5958
- name: Concepts
6059
items:
61-
- name: Harm categories
62-
href: concepts/harm-categories.md
6360
- name: Prompt Shields
6461
href: concepts/jailbreak-detection.md
6562
- name: Groundedness detection
6663
href: concepts/groundedness.md
6764
- name: Custom categories (rapid)
6865
href: concepts/custom-categories-rapid.md
66+
- name: Harm categories
67+
href: concepts/harm-categories.md
6968
- name: Reference
7069
items:
7170
- name: Azure AI Content Safety REST API

0 commit comments

Comments
 (0)