Skip to content

Commit 9604578

Browse files
authored
Merge pull request #1400 from laujan/add-overview-faq-service-limits
Add overview faq service limits
2 parents a922387 + a2c5e93 commit 9604578

File tree

3 files changed

+99
-89
lines changed

3 files changed

+99
-89
lines changed

articles/ai-services/content-understanding/faq.yml

Lines changed: 1 addition & 16 deletions
Original file line numberDiff line numberDiff line change
@@ -59,26 +59,11 @@ sections:
5959
What security measures are in place to protect data processed by Content Understanding?
6060
answer: |
6161
Azure AI Services, including Content Understanding, adheres to strict security and compliance standards to ensure data protection. These measures include data encryption, secure access controls, and compliance with industry regulations such as GDPR and HIPAA. The service also adheres to Microsoft’s responsible use of AI.
62-
- question: |
63-
How do the capabilities of Azure AI Content Understanding compare to Document Intelligence
64-
answer: |
65-
Azure AI Content Understanding and Document Intelligence are both powerful tools, but they serve different purposes and have distinct capabilities.
66-
Azure AI Content Understanding integrates various data types like text, images, videos, and audio, providing comprehensive analysis and insights using Generative AI. The service is ideal for applications needing diverse data integration for automation, Search, and Retrieval-Augmented Generation (RAG), analytics, and reporting.
67-
Conversely, Document Intelligence focuses on extracting and processing key data from documents, such as invoices, forms, and contracts, converting unstructured data into structured, usable information.
68-
- question: |
69-
How can I migrate from Document Intelligence to Azure AI Content Understanding?
70-
answer: |
71-
Currently, migration from Document Intelligence to Content Understanding is unavailable.
7262
- question: |
7363
What base models does Azure AI Content Understanding use?
7464
answer: |
7565
Content Understanding uses various models and capabilities from Azure OpenAI, Azure AI Speech, Vision, and Language to support single- modality and multi-modal scenarios. The service determines the selection of base models appropriate for each scenario.
7666
- question: |
7767
What are the pricing tier options for Content Understanding
7868
answer: |
79-
Content Understanding only supports Standard S0 pricing tier. See more details on the pricing page.
80-
- question: |
81-
How can I get started with Content Understanding?
82-
answer: |
83-
To get started with Content Understanding, visit the Azure AI Studio and get started with Content Understanding. Azure AI Studio provides comprehensive guides, tutorials, and customer support to help you set up and utilize Content Understanding effectively.
84-
69+
Content Understanding only supports Standard S0 pricing tier. See more details on the pricing page.

articles/ai-services/content-understanding/overview.md

Lines changed: 31 additions & 35 deletions
Original file line numberDiff line numberDiff line change
@@ -13,21 +13,19 @@ ms.custom: ignite-2024-understanding-release
1313

1414
# What is Azure AI Content Understanding?
1515

16-
Azure AI Content Understanding is a cloud-based solution within [**Azure AI services**](../what-are-ai-services.md), designed to process/ingest various data modalities such as documents, images, videos, and audio into customizable output formats using Generative AI, Larger Language models (LLM), and Small Language Models (SLM) within a unified workflow.
16+
Azure AI Content Understanding is a new Generative AI based [**Azure AI services**](../what-are-ai-services.md), designed to process/ingest content of any types (documents, images, videos, and audio) into a user-defined output format.
1717

18-
Content Understanding offers a streamlined process to reason over large amounts of unstructured data, build customizable workflows, ultimately accelerating time-to-value (TTV), while varied AI models.
18+
Content Understanding offers a streamlined process to reason over large amounts of unstructured data, accelerating time-to-value (TTV) to seamlessly integrate the output into automation and analytical workflows used by downstream applications.
1919

2020
:::image type="content" source="media/overview/content-understanding-overview.png" lightbox="media/overview/content-understanding-process.png" alt-text="Screenshot of accepted media input files.":::
2121

22-
### Why use Content Understanding?
22+
### Why process with Content Understanding?
2323

24-
* **Simplified and streamlined workflows**. Content Understanding unifies the process for extracting data from any modality or combination of modalities, creating a unified approach to processing all types of content.
24+
* **Simplify and streamline workflows**. Content Understanding standardizes the extraction of data from various content types, providing a unified method for processing all types of content.
2525

26-
* **Simplified Content Extraction**. Content Understanding's schema definition streamlines the generation of structured output from various content types. Users are enabled to define schemas where fields can be extracted, inferred, or abstracted without requiring complex prompt engineering.
26+
* **Simplify field extraction**. Content Understanding's schema definition makes it easier to generate structured output from various content types. Users can define schemas to extract, classify, or generate field values without needing complex prompt engineering.
2727

28-
* **Efficiency and Cost Reduction**. Automating the ingestion and analysis of large amounts of data from varied sources reduces the cost associated with building Generative AI automation solutions.
29-
30-
* **Enhanced Accuracy**. Content Understanding uses multiple data modalities to simultaneously analyze and cross-validate information, leading to more accurate and reliable results.
28+
* **Enhance accuracy**. Content Understanding employs multiple AI models to analyze and cross-validate information simultaneously, resulting in more accurate and reliable results.
3129

3230
### Content Understanding use cases
3331

@@ -37,50 +35,48 @@ Content Understanding offers a streamlined process to reason over large amounts
3735

3836
* **Analytics and Reporting**: Content Understanding's extracted schema outputs enhance analytics and reporting, allowing businesses to gain valuable insights, conduct deeper analysis and make informed decisions from accurate reports.
3937

40-
* **Business leaders and c-suite executives**. Decision makers gain actionable insights from Content Understanding solutions. Generative
41-
AI powered results and high confidence scores lead to enlightened data-driven decisions and minimize the need for human review.
38+
## Applications
39+
Common applications for Content Understanding include:
40+
41+
|Application|Description|Quickstart|
42+
|:---------|:----------|:----------|
43+
|Post-call analytics| Businesses and call centers can generate insights from call recordings to track key KPIs, improve product experience, generate business insights, create differentiated customer experiences, and answer queries faster and more accurately.| **Post-call analytics quickstart**|
44+
|Media asset management| Software and media vendors can use Content Understanding to extract richer, targeted information from videos for media asset management solutions.| **Media asset management quickstart** |
45+
|Tax automation| Tax preparation companies can use Content Understanding to generate a unified view of information from various documents and create comprehensive tax returns.| **Tax automation quickstart** |
46+
|Chart understanding| Businesses can enhance chart understanding by automating the analysis and interpretation of various types of charts and diagrams using Content Understanding.| **Chart understanding quickstart** |
47+
48+
See [Quickstart](quickstart/use-scenario-templates.md) for more examples.
4249

43-
* **Developers**. Computer application and system professionals can address enterprise-specific use cases by creating customized workflows using various input data types and deployed custom models.
4450

45-
* **Subject matter experts**: Domain and subject matter experts benefit from streamlined output, enhanced automation, and high confidence scores.
51+
## Capabilities
4652

47-
## Features and capabilities
4853
|Capability|Description|
4954
|:---------|:----------|
50-
|Diverse modality processing|Content Understanding intakes document, image, audio, video, and mixed media input and converts it into a structured format easily analyzed and further processed by other services and applications.|
51-
|High-level schema extraction|Users can define the structure and the schema of the extracted results or use a predefined schema for specific schema values: </br></br>&bullet; **Extracted (explicit)**. Values like the name of the product in a recording or the brand/logo from a video are examples of extracted values.</br></br>&bullet; **Inferred (implicit)**. Inferred values aren't explicitly present in the content but can be determined based on the content. The sum of all line items in an invoice or the end date of a contract given a start date and duration are examples of inferred values.</br></br>&bullet; **Abstracted (tacit)**. Abstracted values are generated based on the content of the input. Examples include summaries, outlines, recaps are examples of abstracted values.
52-
|Comprehensive content extraction and analysis| Content Understanding is equipped with the capability to automatically identify and extract pertinent information from diverse file types. This functionality is available for certain file formats, including documents, audio, and video. The service can analyze data within these files and extract text, key-value pairs, tables, and structure from documents, as well as transcriptions from video and audio files. <br> <br> The primary objective is to transform unstructured data into structured, actionable information that can be readily accessed and utilized.|
53-
|Grounded results for higher accuracy|Content Understanding ensures that responses are anchored to your input files, leading to higher precision in extracted values. The source information is pivotal to assessing groundedness, serving as the foundation for both grounding and accuracy. A grounded response adheres strictly to the provided information, avoiding any speculation or fabrication. |
54-
|Highly precise confidence scores|Content Understanding ensures accuracy across contexts for extracted fields. A confidence score from 0 to 100 measures the statistical certainty of the result's reliability. High scores indicate precise data extraction, enabling straight-through processing (STP) in automation workflows.|
55-
|Precise and efficient extraction of modality-specific details for secondary processing scenarios| Users can extract specific content that is suitable for secondary scenarios like Large Language Model (LLM) processing.|
56-
57-
## Scenarios
58-
Common scenarios for Azure AI Content Understanding service include:
59-
60-
|Use|Scenario|Scenario Quickstart|
61-
|--------|-------|-------|
62-
|Call center post-call analytics| Businesses and call center operators can generate insights from call recordings to track key KPIs to improve product experience, generate business insights, create differentiated customer experiences, and answer queries faster and more accurately.| [**Post call analytics Quickstart**](prebuilt-template/post-call-analytics.md) |
63-
|Marketing automation digital asset management| Independent software and media vendors that build media asset management solutions can use Content Understanding to extract richer, targeted content from images and videos.| [**Media asset management prebuilt template**](prebuilt-template/manage-video-assets.md)|
64-
|Tax processing automation| Tax preparing companies can use the extended capabilities of Content Understanding to generate a unified view of information from different documents and generate comprehensive tax returns.| Quick start|
65-
Chart Understanding| Businesses can significantly enhance chart understanding by automating the analysis and interpretation of various types of charts and diagrams using Content Understanding. This capability is useful in several downstream use cases.| Quickstart |
55+
|Content extraction | Content Understanding recognizes content from documents, images, audio, and video for easy analysis and further processing.|
56+
|Field extraction|Users can define the structure and schema of the desired extracted fields or customize from templates for common scenarios. Fields can be generated via multiple methods:</br></br> &bullet; **Extract**: Directly extract values as they appear in the input content, such as extracting dates from receipts or item details from invoices.</br></br>&bullet; **Classify**: Classify content from a predefined set of categories, such as determining call sentiment or chart type.</br></br>&bullet; **Generate**: Generate values freely from input data, such as summarizing an audio conversation or generating scene descriptions from videos.|
57+
|Grounding Source| Content Understanding identifies the specific regions in the content where the value was generated from. Source grounding allows users in automation scenarios to quickly verify the correctness of the field values, leading to higher confidence in the extracted data. |
58+
|Confidence Score | Content Understanding provides confidence scores from 0 to 1 to estimate the reliability of the results. High scores indicate accurate data extraction, enabling straight-through processing in automation workflows.|
59+
|Add-ons| Content Understanding add-ons enhance content extraction by incorporating added elements like barcodes, tables, and detected faces.|
60+
6661

6762
## Responsible AI
68-
At Microsoft, we prioritize advancing AI with a people-first approach. Generative models in Azure AI Content Understanding have great potential but can produce incorrect or harmful content without careful design. For more information, *see* [Microsoft Responsible AI dashboard](/azure/machine-learning/concept-responsible-ai-dashboard), [Adopt responsible and trusted AI principles](/azure/cloud-adoption-framework/strategy/responsible-ai), and follow our [**Empowering responsible AI practices**](https://www.microsoft.com/ai/responsible-ai) guidance.
63+
64+
Azure AI Content Understanding is designed to guard against processing harmful content. For more information, *see* our **Transparency Note** and [**Code of Conduct**](/legal/cognitive-services/openai/code-of-conduct#see-also).
6965

7066
## Data privacy and security
7167

72-
As with all the Azure AI services, developers using the Content Understanding service should be aware of Microsoft's policies on customer data. See our [**Data, protection and privacy**](https://www.microsoft.com/trust-center/privacy) page to learn more.
68+
Developers using the Content Understanding service should review Microsoft's policies on customer data. For more information, visit our [**Data, protection and privacy**](https://www.microsoft.com/trust-center/privacy) page.
7369

7470
> [!IMPORTANT]
7571
> If you are using Microsoft products or services to process Biometric Data, you are responsible for: (i) providing notice to data subjects, including with respect to retention periods and destruction; (ii) obtaining consent from data subjects; and (iii) deleting the Biometric Data, all as appropriate and required under applicable Data Protection Requirements. "Biometric Data" will have the meaning set forth in Article 4 of the GDPR and, if applicable, equivalent terms in other data protection requirements. For related information, see [Data and Privacy for Face](/legal/cognitive-services/face/data-privacy-security).
7672
7773
## Getting started
78-
Before you get started using Content Understanding, you need an [**Azure AI services multi-service resource**](how-to/create-multi-service-resource.md). The multi-service resource enables access to multiple Azure AI services with a single set of credentials.
7974

80-
We provide quickstart guides designed to help you begin utilizing Content Understanding service swiftly:
75+
Our quickstart guides help you quickly start using the Content Understanding service:
76+
77+
* [**Rest API Quickstart**](quickstart/use-rest-api.md)
78+
* **Azure AI Foundry Quickstart**
8179

82-
* **[**Rest API Quickstart**](quickstart/use-rest-api.md)**
83-
* **Azure AI Studio Quickstart**
8480

8581

8682

0 commit comments

Comments
 (0)