You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/ai-services/content-understanding/concepts/best-practices.md
+19-16Lines changed: 19 additions & 16 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -12,56 +12,59 @@ ms.date: 02/24/2025
12
12
13
13
# Best Practices for Content Understanding
14
14
15
-
Azure AI Content Understanding in an innovative Generative AI service designed to facilitate the precise and accurate analysis of extensive data sets. The service proficiently processes various content modalities, including documents, images, videos, and audio, transforming them into a user-specified output format. This document provides guidance and best practices to effectively utilize Content Understanding for your data processing and analysis requirements.
15
+
Azure AI Content Understanding is an innovative Generative AI service designed to facilitate the precise and accurate analysis of extensive data sets. The service processes various content modalities, including documents, images, videos, and audio, transforming them into user-specified output formats.
16
16
17
+
This document provides guidance and best practices to effectively utilize Content Understanding for your data processing and analysis requirements.
18
+
19
+
---
17
20
18
21
## Use field descriptions to guide output
19
22
20
23
When defining a schema, it's essential to provide detailed field descriptions. Clear and concise descriptions guide the model to focus on the correct information, improving the accuracy of the output.
21
24
22
25
#####  ***Example***
23
26
24
-
* If you want to extract the date from an invoice, in addition to naming the field `"Date"`, provide a description such as:
27
+
* If you want to extract the date from an invoice, in addition to naming the field `Date`, provide a description such as:
25
28
26
29
27
-
> **"The date when the invoice was issued, typically found at the top right corner of the document."**
30
+
> `The date when the invoice was issued, typically found at the top right corner of the document.`
28
31
29
32
30
33
#####  ***Example***
31
34
32
-
* Suppose you want to extract the `"Customer Name"` from an invoice. Your description might read:
35
+
* Suppose you want to extract the `Customer Name` from an invoice. Your description might read:
33
36
34
-
**"The name of the customer or client to whom this invoice is addressed, usually located near the billing address. It should be the name of the business or person, but not the entire mailing address."**
37
+
> `The name of the customer or client to whom this invoice is addressed, usually located near the billing address. It should be the name of the business or person, but not the entire mailing address.`
35
38
---
36
39
37
40
## Correct mistakes by editing field descriptions
38
41
39
-
If the system's output isn't meeting expectations, the first thing to try is refining and updating the field descriptions. By clarifying the context and being more explicit about what you need, you reduce ambiguity and improve accuracy.
42
+
If the system's output isn't meeting expectations, the first step is to try refining and updating the field descriptions. Clarifying the context and being more explicit about what you need, reduces ambiguity and improves accuracy.
40
43
41
44
#####  ***Example***
42
45
43
-
* If the `"shipping date"` field generated inconsistent or incorrect extraction, often after a "Dispatch Date" label, update it to something more precise like:
46
+
* If the `Shipping date` field generated inconsistent or incorrect extraction, often after a `Dispatch Date` label, update it to something more precise like:
44
47
45
-
**"The date when the products were shipped, typically found below the item list. It may also be labeled something similar like Delivery Date or Dispatch Date. Dates should typically have a format like 1/23/2024 or 01-04-2025."**
48
+
> `The date when the products were shipped, typically found below the item list. It may also be labeled something similar like Delivery Date or Dispatch Date. Dates should typically have a format like 1/23/2024 or 01-04-2025.`
46
49
47
50
* This extra context guides the model to the right location in the document.
48
51
49
52
50
53
## Use classification fields for specific outputs
51
54
52
-
When you need the system to choose from a set of predefined options (for example, document type, product category, or status), use classification fields. When there's ambiguity with the options, provide clear descriptions for each option, enabling the model to categorize the data accurately.
55
+
When you need the system to choose from a set of predefined options, for example, document type, product category, or status, use classification fields. Where there's ambiguity with the options, provide clear descriptions for each option, enabling the model to categorize the data accurately.
53
56
54
57
#####  ***Example***
55
58
56
-
* If you need to classify documents as either `"Invoice"`, `"Claim"`, or `"Report"`, create a classification field with these words as category names.
59
+
* If you need to classify documents as either `Invoice`, `Claim`, or `Report`, create a classification field with these words as category names.
57
60
58
61
#####  ***Example***
59
62
60
-
* When processing product images, you might need to assign them to categories like `"AlcoholicDrinks"`, `"SoftDrinks"`, `"Snacks"`, and `"DairyProducts"`. Since some items can appear similar, providing precise definitions for close-call cases can help. For example:
63
+
* When processing product images, you might need to assign them to categories like `AlcoholicDrinks`, `SoftDrinks`, `Snacks`, and `DairyProducts`. Since some items can appear similar, providing precise definitions for close-call cases can help. For example:
61
64
62
-
***`"Alcoholic Drinks"`**: Beverages containing alcohol, such as beer, wine, and spirits. This category excludes soft drinks or other nonalcoholic beverages.
65
+
***`Alcoholic Drinks`**: Beverages containing alcohol, such as beer, wine, and spirits. This category excludes soft drinks or other nonalcoholic beverages.
63
66
64
-
***`"Soft Drinks"`**: Carbonated nonalcoholic beverages, such as soda and sparkling water. This category doesn't include juices or alcoholic drinks.
67
+
***`Soft Drinks`**: Carbonated nonalcoholic beverages, such as soda and sparkling water. This category doesn't include juices or alcoholic drinks.
65
68
66
69
* By clearly defining each category, you ensure that the system correctly classifies products while minimizing misclassification.
67
70
@@ -71,17 +74,17 @@ Confidence scores help you decide when to involve human reviewers. Customers can
71
74
72
75
#####  ***Example***
73
76
74
-
* For an invoice review use case, if a key extracted field like `"TotalInvoiceAmount"` has a confidence score under **0.80**, route that document to manual review. This helps ensure that a human verifies critical fields like invoice totals or legal statements when necessary.
77
+
* For an invoice review use case, if a key extracted field like `TotalInvoiceAmount` has a confidence score under **0.80**, route that document to manual review. This helps ensure that a human verifies critical fields like invoice totals or legal statements when necessary.
75
78
76
-
* You might set different confidence thresholds based on the type of field. For instance, a lower threshold for a `"Comments"` field that's less critical and a higher one for `"ContractTerminationDate"` to ensure no mistakes.
79
+
* You might set different confidence thresholds based on the type of field. For instance, a lower threshold for a `Comments` field that's less critical and a higher one for `ContractTerminationDate` to ensure no mistakes.
77
80
78
81
## Reduce errors by narrowing language selection for audio and video
79
82
80
83
When you're working with audio and video content, selecting a narrow set of languages for transcription can potentially reduce errors. The more languages you include, the more the system has to guess which language is being spoken, which cam increase misrecognition.
81
84
82
85
#####  ***Example***
83
86
84
-
* If you're certain that the content only contains English and Spanish, configuring your transcription to these two languages only can improve quality. But if the content accidentally includes other languages, such configuration can actually degrade overall quality.
87
+
* If you're certain that the content only contains English and Spanish, configuring your transcription to only these two languages can improve quality. But if the content accidentally includes other languages, such configuration can actually degrade overall quality.
85
88
86
89
87
90
## Transcript, document text, and speaker data don't require fields
0 commit comments