Merge pull request #284287 from MicrosoftDocs/main

Publish to live, Sunday 4 AM PST, 8/11

Author: ttorble

articles/ai-services/document-intelligence/concept-custom-generative.md

@@ -1,87 +1,116 @@
 ---
-title: Azure AI Document Intelligence (formerly Form Recognizer) custom generative field extraction
+title: Azure AI Document Intelligence (formerly Form Recognizer) custom generative document field extraction
 titleSuffix: Azure AI services
 description: Custom generative AI model extracts user-specified fields from documents across a wide variety of visual templates.
 author: laujan
 manager: nitinme
 ms.service: azure-ai-document-intelligence
-ms.custom:
-  - ignite-2023
 ms.topic: overview
-ms.date: 08/07/2024
+ms.date: 08/09/2024
 ms.author: lajanuar
 monikerRange: '>=doc-intel-4.0.0'
 ---
 
-# Document Intelligence custom generative model
+# Document Field extraction - custom generative AI model
 
-[!INCLUDE [preview-version-notice](includes/preview-notice.md)]
+> [!IMPORTANT]
+>
+> * Document Intelligence public preview releases provide early access to features that are in active development. Features, approaches, and processes may change, prior to General Availability (GA), based on user feedback.
+> * The public preview version of Document Intelligence client libraries default to REST API version [**2024-07-31-preview**](/rest/api/aiservices/operation-groups?view=rest-aiservices-2024-07-31-preview&preserve-view=true) and is currently only available in the following Azure regions.
+>   * **East US**
+>   * **West US2**
+>   * **West Europe**
+>   * **North Central US**
+>
+> * **The new custom generative model in AI Studio is only available in the North Central US region**:
 
-The custom generative model combines the power of document understanding with Large Language Models (LLMs) and the rigor and schema from custom extraction capabilities. Custom generative extraction enables you to easily automate data extraction workflows for any type of document, with minimal labeling and greater accuracy and speed.
+The document field extraction (custom generative AI) model utilizes generative AI to extract user-specified fields from documents across a wide variety of visual templates. The custom generative AI model combines the power of document understanding with Large Language Models (LLMs) and the rigor and schema from custom extraction capabilities to create a model with high accuracy in minutes. With this generative model type, you can start with a single document and go through the schema addition and model creation process with minimal labeling. The custom generative model allows developers and enterprises to easily automate data extraction workflows with greater accuracy and speed for any type of document. The custom generative AI model excels in extracting simple fields from documents without labeled samples. However, providing a few labeled samples improves the extraction accuracy for complex fields and user-defined fields like tables. You can use the [REST API](/rest/api/aiservices/operation-groups?view=rest-aiservices-2024-07-31-preview&preserve-view=true) or client libraries to submit a document for analysis with a model build and use the custom generative process.
 
-## Custom generative model key features
+## Custom generative AI model benefits
 
 * **Automatic labeling**. Utilize large language models (LLM) and extract user-specified fields for various document types and visual templates.
+
 * **Improved Generalization**. Extract data from unstructured data and varying document templates with higher accuracy.
-* **Grounded results**. Localize the data extracted in documents and ensure the response is generated from the content and enables human review workflows.
-* **High confidence scores**. Use confidence scores and quickly filter high quality extracted data for downstream processing and lower manual review time.
+
+* **Grounded results**. Localize the data extracted in the documents. Custom generative models ground the results where applicable, ensuring the response is generated from the content and enable human review workflows.
+
+* **Confidence scores**. Use confidence scores for each extracted field to, filter high quality extracted data, maximize straight through processing of documents and minimize human review costs.
 
 ### Common use cases
 
-* **Contract Lifecycle Management**. Build a generative model and extract the fields, clauses, and obligations from a wide array of contract types.  
-* **Loan & Mortgage Applications**. Automation of loan and mortgage application process enables banks, lenders, and government entities to quickly process loan and mortgage application.  
-* **Financial Services**. Analyze complex documents like financial reports and asset management reports.
-* **Expense management**. The custom generative model can extract expenses, receipts, and invoices with varying formats and templates.  
+* **Contract Lifecycle Management**. Build a generative model and extract the fields, clauses, and obligations from a wide array of contract types.
+
+* **Loan & Mortgage Applications**. Automation of loan and mortgage application process enables banks, lenders, and government entities to quickly process loan and mortgage application.
+
+* **Financial Services**. With the custom generative AI model, analyze complex documents like financial reports and asset management reports.
+
+* **Expense management**. Receipts and invoices from various retailers and businesses need to be parsed to validate the expenses. The custom generative AI model can extract expenses across different formats and documents with varying templates.
+
+### Managing the training dataset
+
+With our other custom models, you need to maintain the dataset, add new samples, and train the model for accuracy improvements. With the custom generative AI model, the labeled documents are transformed, encrypted, and stored as part of the model. This process ensures that the model can continually use the labeled samples to improve the extraction quality. As with other custom models, models are stored in Microsoft storage, and you can delete them anytime.
+
+The Document Intelligence service does manage your datasets, but your documents are stored encrypted and only used to improve the model results for your specific model. A service-manged key can be used to encrypt your data or it can be optionally encrypted with a customer managed key. The change in management and lifecycle of the dataset only applies to custom generative models.
 
 ## Model capabilities  
 
-The Custom generative model currently supports dynamic table with the `2024-07-31-preview` and the following fields:
+Field extraction custom generative model currently supports dynamic table with the `2024-07-31-preview` and the following fields:
 
 | Form fields | Selection marks | Tabular fields | Signature | Region labeling | Overlapping fields |
 |:--:|:--:|:--:|:--:|:--:|:--:|
 |Supported| Supported |Supported| Unsupported |Unsupported |Supported|
 
 ## Build mode  
 
-The `build custom model` operation supports custom _template_, _neural_ and _generative_ models, _see_ [Custom model build mode](concept-custom.md#build-mode):
+The `build custom model` operation supports custom **template**, **neural**, and **generative** models, _see_ [Custom model build mode](concept-custom.md#build-mode). Here are the differences in the model types:
+
+* **Custom generative AI models** can process complex documents with various formats, varied templates, and unstructured data.
+
+* **Custom neural models** support complex document processing and also support more variance in pages for structured and semi-structured documents.
 
-* **Custom generative models** can process complex documents in various formats, templates, and unstructured data.
-* **Custom neural models** support complex document processing and also support more variance in page for structured and semi-structured documents.
 * **Custom template models** rely on consistent visual templates, such as questionnaires or applications, to extract the labeled data.
 
 ## Languages and locale support
 
-The custom generative model `2024-07-31-preview` version supports the **en-us** locale. For more information on language support, *see* [Language support - custom models](language-support-custom.md).
+Field extraction custom generative model `2024-07-31-preview` version supports the **en-us** locale. For more information on language support, _see_ [Language support - custom models](language-support-custom.md).
 
 ## Region support
 
-The custom generative model `2024-07-31-preview` version is only available in `North Central US`.  
+Field extraction custom generative model `2024-07-31-preview` version is only available in `North Central US`.  
 
-## Input requirements 
+## Input requirements
 
 [!INCLUDE [input requirements](./includes/input-requirements.md)]
 
 ## Best practices  
 
 * **Representative data**. Use representative documents that target actual data distribution, and train a high-quality custom generative model. For example, if the target document includes partially filled tabular fields, add training documents that consist of partially filled tables. Or if field is named date, values for this field should be a date as random strings can affect model performance.
+
 * **Field naming**. Choose a precise field name that represents the field values. For example, for a field value containing the Transaction Date, consider naming the field _TransactionDate_ instead of `Date1`.
-* **Field Description**. Provide more contextual information in description to help clarify the field that needs to be extracted. Examples include location in the document, potential field labels it may be associated with, ways to differentiate with other terms that could be ambiguous.  
-* **Variation**. Custom generative models can generalize across different document templates of the same document type. As a best practice, create a single model for all variations of a document type. Ideally, include a visual template for each type, especially for ones that 
+
+* **Field Description**. Provide more contextual information in description to help clarify the field that needs to be extracted. Examples include location in the document, potential field labels it can be associated with, and ways to differentiate with other terms that could be ambiguous.
+
+* **Variation**. Custom generative models can generalize across different document templates of the same document type. As a best practice, create a single model for all variations of a document type. Ideally, include a visual template for each type, especially for ones that
 
 ## Service guidance
 
 * The Custom Generative preview model doesn't currently support fixed table and signature extraction.
+
 * Inference on the same document could yield slightly different results across calls and is a known limitation of current `GPT` models.
+
 * Confidence scores for each field might vary. We recommend testing with your representative data to establish the confidence thresholds for your scenario.
-* Grounding, especially for tabular fields, is challenging and might not be perfect in some cases.  
+
+* Grounding, especially for tabular fields, is challenging and might not be perfect in some cases.
+
 * Latency for large documents is high and a known limitation in preview.
+
 * Composed models don't support custom generative extraction.
 
 ## Training a model  
 
 Custom generative models are available with the `2024-07-31-preview` version and later models.
 
-The `build operation` to train model supports the ```buildMode``` property, to train a custom generative model, set the ```buildMode``` to ```generative```.
+The `build operation` to train model supports the `buildMode` property, to train a custom generative model, set the `buildMode` to `generative`.
 
 ```bash
 

articles/ai-services/document-intelligence/includes/preview-notice.md

@@ -13,8 +13,7 @@ ms.date: 07/31/2024
 
 > [!IMPORTANT]
 >
-> * Document Intelligence public preview releases provide early access to features that are in active development.
-> * Features, approaches, and processes may change, prior to General Availability (GA), based on user feedback.
+> * Document Intelligence public preview releases provide early access to features that are in active development. Features, approaches, and processes may change, prior to General Availability (GA), based on user feedback.
 > * The public preview version of Document Intelligence client libraries default to REST API version [**2024-07-31-preview**](/rest/api/aiservices/operation-groups?view=rest-aiservices-2024-07-31-preview&preserve-view=true).
 > * Public preview version [**2024-07-31-preview**](/rest/api/aiservices/operation-groups?view=rest-aiservices-2024-07-31-preview&preserve-view=true) is currently only available in the following Azure regions. Note that the custom generative (document field extraction) model in AI Studio is only available in North Central US region:
 >   * **East US**

articles/ai-services/speech-service/ingestion-client.md

@@ -26,7 +26,6 @@ An Azure account and a multi-service Azure AI services resource are needed to ru
 * <a href="https://portal.azure.com/#create/Microsoft.CognitiveServicesAIServices"  title="Create an Azure AI services resource"  target="_blank">Create an Azure AI services resource</a> in the Azure portal.
 * Get the resource key and region. After your resource is deployed, select **Go to resource** to view and manage keys. For more information about Azure AI services resources, see [this quickstart](~/articles/ai-services/multi-service-resource.md?pivots=azportal). 
 
-See the [Getting Started Guide for the Ingestion Client](https://github.com/Azure-Samples/cognitive-services-speech-sdk/blob/master/samples/ingestion/ingestion-client/Setup/guide.md) on GitHub to learn how to set up and use the tool.
 
 ## Ingestion Client Features
 

articles/ai-studio/concepts/connections.md

@@ -38,6 +38,9 @@ Azure AI Studio supports connections to non-Microsoft services, including the fo
 
 ## Connections to datastores
 
+> [!IMPORTANT]
+> Data connections cannot be shared across projects. They are created exclusively in the context of one project. 
+
 Creating a data connection allows you to access external data without copying it to your project. Instead, the connection provides a reference to the data source.
 
 A data connection offers these benefits:

articles/ai-studio/concepts/evaluation-approach-gen-ai.md

@@ -9,7 +9,7 @@ ms.custom:
   - build-2024
 ms.topic: conceptual
 ms.date: 5/21/2024
-ms.reviewer: eur
+ms.reviewer: mithigpe
 ms.author: lagayhar
 author: lgayhardt
 ---

articles/ai-studio/concepts/evaluation-improvement-strategies.md

@@ -9,7 +9,7 @@ ms.custom:
   - build-2024
 ms.topic: conceptual
 ms.date: 5/21/2024
-ms.reviewer: eur
+ms.reviewer: mithigpe
 ms.author: lagayhar
 author: lgayhardt
 ---

articles/ai-studio/how-to/data-add.md

@@ -38,7 +38,7 @@ To create and work with data, you need:
 
 ## Create data
 
-When you create your data, you need to set the data type. AI Studio supports three data types:
+When you create your data, you need to set the data type. AI Studio supports these data types:
 
 |Type  |**Canonical Scenarios**|
 |---------|---------|

articles/ai-studio/how-to/evaluate-flow-results.md

@@ -9,7 +9,7 @@ ms.custom:
   - build-2024
 ms.topic: how-to
 ms.date: 5/21/2024
-ms.reviewer: eur
+ms.reviewer: wenxwei
 ms.author: lagayhar
 author: lgayhardt
 ---

articles/ai-studio/how-to/evaluate-generative-ai-app.md

@@ -7,7 +7,7 @@ ms.service: azure-ai-studio
 ms.custom: ignite-2023, references_regions, build-2024
 ms.topic: how-to
 ms.date: 5/21/2024
-ms.reviewer: eur
+ms.reviewer: mithigpe
 ms.author: lagayhar
 author: lgayhardt
 ---

articles/ai-studio/how-to/evaluate-prompts-playground.md

@@ -9,7 +9,7 @@ ms.custom:
   - build-2024
 ms.topic: how-to
 ms.date: 5/21/2024
-ms.reviewer: eur
+ms.reviewer: mithigpe
 ms.author: lagayhar
 author: lgayhardt
 ---