You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/ai-services/content-understanding/glossary.md
+2Lines changed: 2 additions & 0 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -24,6 +24,8 @@ ms.author: lajanuar
24
24
|**Field schema**| A formal description of the fields to extract from the input. It specifies the name, description, value type, generation method, and more for each field. |
25
25
|**Generation method**| The process of determining the extracted value of a specified field. Content Understanding supports: <br/> •**Extract**: Directly extract values from the input content, such as dates from receipts or item details from invoices. <br/> •**Classify**: Classify content into predefined categories, such as call sentiment or chart type. <br/> •**Generate**: Generate values from input data, such as summarizing an audio conversation or generating scene descriptions from videos. |
26
26
|**Span**| A reference indicating the location of an element (for example, field, word) within the extracted Markdown content. A character offset and length represent a span. Different programming languages use various character encodings, which can affect the exact offset and length values for Unicode text. To avoid confusion, spans are only returned if the desired encoding is explicitly specified in the request. Some elements can map to multiple spans if they aren't contiguous in the markdown (for example, page). |
27
+
| **Processing Location** | An API request parameter that defines the geographic region where Azure AI Services analyzes your data. You can choose from three options: `geography`, `dataZone`, and `global` to control where processing occurs. This setting helps meet data residency requirements and optimize performance or scalability based on your needs. For more information, *see* the Content Understanding API reference documentation.
27
28
|**Grounding source**| The specific regions in content where a value was generated. It has different representations depending on the file type: <br>•**Image** - A polygon in the image, often an axis-aligned rectangle (bounding box). <br>•**PDF/TIFF** - A polygon on a specific page, often a quadrilateral. <br>•**Audio** - A start and end time range. <br>•**Video** - A start and end time range with an optional polygon in each frame, often a bounding box.|
29
+
|**Person directory**| A structured way to store face data for recognition tasks. You can add individual faces to the directory and later search for visually similar faces. You can also create person profiles, associate faces to them, and match new face images to known individuals. This setup supports both flexible face matching and identity recognition across images and videos. |
28
30
|**Confidence score**| The level of certainty that the extracted data is accurate. |
29
31
|**Category**| A distinct class within a classifier used to group similar input files based on shared characteristics or features. |
Copy file name to clipboardExpand all lines: articles/ai-services/content-understanding/image/overview.md
+9-16Lines changed: 9 additions & 16 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -28,7 +28,7 @@ Azure AI Content Understanding standardizes the extraction of data from images,
28
28
29
29
***Shelf analysis and inventory management:** Detect, count, and extract specific details about retail products, optimizing operations, and improving customer satisfaction by ensuring products are well-stocked and properly organized.
30
30
31
-
## Key Benefits
31
+
## Key benefits
32
32
33
33
Content Understanding offers several key benefits for extracting information from images, including,
34
34
@@ -38,31 +38,24 @@ Content Understanding offers several key benefits for extracting information fro
38
38
39
39
***Faster and more cost-effective automation:** The extracting of only the necessary fields enables Content Understanding to streamlines automation. Thus allowing organizations to scale their data processing workflows efficiently and reduce the storage and processing of irrelevant data.
40
40
41
+
:::image type="content" source="../media/image/image-flow-diagram.jpg" alt-text="Screenshot of a data flow diagram for image processing in content understanding.":::
41
42
42
-
## Input requirements
43
-
For detailed information on supported input file formats, refer to our [Service quotas and limits](../service-limits.md) page.
43
+
## Get started
44
+
45
+
Get started with processing images with Content Understanding by following our [REST API quickstart](LINK TO IMAGE TAB) or visiting [Azure AI Foundry](https://aka.ms/cu-landing) for a no code experience.
44
46
45
47
> [!NOTE]
46
48
> For best results, image schema should only be used to process non-document-based images.
47
49
> Text heavy images of documents should be processed using a document schema.
48
50
> Use cases that require extraction of text from document images or scanned documents should be processed using a document field extraction schema.
49
51
50
-
## Supported languages and regions
51
-
For a detailed list of supported languages and regions, visit our [Language and region support](../language-region-support.md) page.
52
-
53
-
## Supported field types
54
-
For detailed information on supported field types, refer to our [Service quotas and limits](../service-limits.md#field-type-limits) page.
55
-
56
-
## Data privacy and security
57
-
58
-
As with all the Azure AI services, developers using the Content Understanding service should be aware of Microsoft's policies on customer data. See our [**Data, protection and privacy**](https://www.microsoft.com/trust-center/privacy) page to learn more.
59
52
60
53
> [!IMPORTANT]
61
54
> If you're using Microsoft products or services to process Biometric Data, you're responsible for: (i) providing notice to data subjects, including with respect to retention periods and destruction; (ii) obtaining consent from data subjects; and (iii) deleting the Biometric Data, all as appropriate, and required under applicable Data Protection Requirements. "Biometric Data" has the meaning articulated in Article 4 of the GDPR and, if applicable, equivalent terms in other data protection requirements. For related information, see [Data and Privacy for Face](/legal/cognitive-services/face/data-privacy-security).
62
55
63
56
## Next steps
64
57
65
-
*Try processing your video content using Content Understanding in [Azure AI Foundry portal](https://aka.ms/cu-landing).
66
-
*Learn to analyze video content [**analyzer templates**](../quickstart/use-ai-foundry.md).
67
-
*Review code samples: [**image, text, and table, content extraction**](https://github.com/Azure-Samples/azure-ai-search-with-content-understanding-python#samples).
*For guidance on optimizing your Content Understanding implementations, including schema design tips, see our detailed [Best practices guide](../concepts/best-practices.md).
59
+
*For detailed information on supported input image formats, *see*[Service quotas and limits](../service-limits.md).
Copy file name to clipboardExpand all lines: articles/ai-services/content-understanding/overview.md
+3-3Lines changed: 3 additions & 3 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -70,12 +70,11 @@ See [Quickstart](quickstart/use-ai-foundry.md) for more examples.
70
70
|Grounding source| Content Understanding identifies the specific regions in the content where the value was generated from. Source grounding allows users in automation scenarios to quickly verify the correctness of the field values, leading to higher confidence in the extracted data. |
71
71
|Confidence score | Content Understanding provides confidence scores from 0 to 1 to estimate the reliability of the results. High scores indicate accurate data extraction, enabling straight-through processing in automation workflows.|
72
72
73
-
74
73
## Responsible AI
75
74
76
75
Azure AI Content Understanding is designed to guard against processing harmful content, such as graphic violence and gore, hateful speech and bullying, exploitation, abuse, and more. For more information and a full list of prohibited content, *see* our [**Transparency note**](/legal/cognitive-services/content-understanding/transparency-note?toc=/azure/ai-services/content-understanding/toc.json&bc=/azure/ai-services/content-understanding/breadcrumb/toc.json) and our [**Code of Conduct**](https://aka.ms/AI-CoC).
77
76
78
-
### Modified Content Filtering
77
+
### Modified content filtering
79
78
80
79
Content Understanding now supports modified content filtering for approved customers. The subscription IDs with approved modified content filtering impacts Content Understanding output. By default, Content Understanding employs a content filtering system that identifies specific risk categories for potentially harmful content in both submitted prompts and generated outputs. Modified content filtering allows the system to annotate rather than block potentially harmful output, giving you the ability to determine how to handle potentially harmful content. For more information on content filter types, *see*[Content filtering: filter types](../openai/concepts/content-filter.md#content-filter-types).
81
80
@@ -84,7 +83,7 @@ Content Understanding now supports modified content filtering for approved custo
84
83
> * Apply for modified content filters via this form: [Azure OpenAI Limited Access Review: Modified Content Filters](https://ncv.microsoft.com/uEfCgnITdR).
85
84
> * For more information, *see*[**Content Filtering**](../openai/concepts/content-filter.md).
86
85
87
-
To learn more about how to add modified content filtering to your requests, *see* our [REST API quickstart](quickstart/use-rest-api.md#modified-content-filtering).
86
+
To learn more about how to add modified content filtering to your requests, *see* our [REST API quickstart](quickstart/use-rest-api.md).
88
87
89
88
## Data privacy and security
90
89
Developers using the Content Understanding service should review Microsoft's policies on customer data. For more information, visit our [**Data, protection and privacy**](https://www.microsoft.com/trust-center/privacy) page.
@@ -93,6 +92,7 @@ Developers using the Content Understanding service should review Microsoft's pol
93
92
> If you're using Microsoft products or services to process Biometric Data, you're responsible for: (i) providing notice to data subjects, including with respect to retention periods and destruction; (ii) obtaining consent from data subjects; and (iii) deleting the Biometric Data, all as appropriate, and required under applicable Data Protection Requirements. "Biometric Data" has the meaning articulated in Article 4 of the GDPR and, if applicable, equivalent terms in other data protection requirements. For related information, see [Data and Privacy for Face](/legal/cognitive-services/face/data-privacy-security).
94
93
95
94
## Getting started
95
+
96
96
Our quickstart guides help you quickly start using the Content Understanding service:
97
97
98
98
*[**Azure AI Foundry portal Quickstart**](quickstart/use-ai-foundry.md)
0 commit comments