Merge branch 'main' of https://github.com/MicrosoftDocs/azure-docs-pr into patricka-uuf-edge-ca

Author: PatAltimore

.openpublishing.publish.config.json

@@ -1290,7 +1290,6 @@
   ".openpublishing.redirection.availability-zones.json",
   ".openpublishing.redirection.azure-app-configuration.json",
   ".openpublishing.redirection.azure-arc-data.json",
-  ".openpublishing.redirection.azure-attestation.json",
   ".openpublishing.redirection.azure-australia.json",
   ".openpublishing.redirection.azure-databricks.json",
   ".openpublishing.redirection.azure-datalake-storage-gen1.json",
@@ -1307,7 +1306,6 @@
   ".openpublishing.redirection.cognitive-services.json",
   ".openpublishing.redirection.container-service.json",
   ".openpublishing.redirection.data-lake-analytics.json",
-  ".openpublishing.redirection.defender-for-cloud.json",
   ".openpublishing.redirection.defender-for-iot.json",
   ".openpublishing.redirection.dev-spaces.json",
   ".openpublishing.redirection.devops-project.json",
@@ -1321,7 +1319,6 @@
   ".openpublishing.redirection.iot-develop.json",
   ".openpublishing.redirection.iot-hub-device-update.json",
   ".openpublishing.redirection.json",
-  ".openpublishing.redirection.key-vault.json",
   ".openpublishing.redirection.machine-configuration.json",
   ".openpublishing.redirection.marketplace.json",
   ".openpublishing.redirection.openshift.json",

.openpublishing.redirection.azure-monitor.json

@@ -5,8 +5,6 @@ description: Extract print and handwritten text from scanned and digital documen
 author: laujan
 manager: nitinme
 ms.service: azure-ai-document-intelligence
-ms.custom:
-  - ignite-2023
 ms.topic: conceptual
 ms.date: 08/07/2024
 ms.author: lajanuar
@@ -122,7 +120,7 @@ The searchable PDF capability enables you to convert an analog PDF, such as scan
   > [!IMPORTANT]
   >
   > * Currently, the searchable PDF capability is only supported by Read OCR model `prebuilt-read`. When using this feature, please specify the `modelId` as `prebuilt-read`, as other model types will return error for this preview version.
-  > * Searchable PDF is included with the 2024-07-31-preview `prebuilt-read` model with no usage cost for general PDF consumption.
+  > * Searchable PDF is included with the 2024-07-31-preview `prebuilt-read` model with no additional cost for generating a searchable PDF output.
 
 ### Use searchable PDF
 
@@ -135,7 +133,7 @@ POST /documentModels/prebuilt-read:analyze?output=pdf
 202
 ```
 
-Once the `Analyze` operation is complete, make a `GET` request to retrieve the `Analyze` operation results.
+Poll for completion of the `Analyze` operation. Once the operation is complete, issue a `GET` request to retrieve the PDF format of the `Analyze` operation results.
 
 Upon successful completion, the PDF can be retrieved and downloaded as `application/pdf`. This operation allows direct downloading of the embedded text form of PDF instead of Base64-encoded JSON.
 

.openpublishing.redirection.defender-for-cloud.json

@@ -7,7 +7,7 @@ metadata:
   ms.service: azure-ai-document-intelligence
   ms.custom: references_regions
   ms.topic: faq
-  ms.date: 07/09/2024
+  ms.date: 08/08/2024
   ms.author: lajanuar
 title: Frequently asked questions
 summary: |
@@ -52,22 +52,23 @@ sections:
         answer: |
           **Yes.**
 
-          You can use a document generative AI solution to chat with your documents, generate captivating content from those documents, and access Azure OpenAI Service models on your data.
+          Document Intelligence now includes [custom generative](concept-custom.md) a new type of extraction model that uses Generative AI and large language models (LLMs) to extract fields from documents. In the past, you used a RAG (retrieval augmented generation) pattern to extract fields. The new model provides high quality results with a single API call.
+          You can also use a document generative AI solution to chat with your documents (RAG), generate captivating content from those documents, and access Azure OpenAI Service models on your data.
 
-          - With Azure AI Document Intelligence and Azure OpenAI combined, you can build an enterprise application to seamlessly interact with your documents by using natural languages. You can easily find answers, gain valuable insights, and generate new and engaging content from existing documents.
+          - With Azure AI Document Intelligence and Azure OpenAI combined, you can build an enterprise application to seamlessly interact with your documents using natural language. You can easily find answers, gain valuable insights, and generate new and engaging content from existing documents.
 
-          - You can find more details in the [technical community blog](https://techcommunity.microsoft.com/t5/azure-ai-services-blog/document-generative-ai-the-power-of-azure-ai-document/ba-p/3875015).
+          - You can find more details on the [retrieval augmented generation pattern here](concept-retrieval-augmented-generation.md).
 
       - question: |
          Can Document Intelligence help with semantic chunking within documents for retrieval-augmented generation?
         answer: |
           **Yes.**
           
-          Document Intelligence can provide the building blocks to enable semantic chunking. Semantic chunking is a key step in retrieval-augmented generation (RAG) to ensure its efficient storage and retrieval.
+          Document Intelligence can provide the building blocks to enable semantic chunking. Semantic chunking is a key step in retrieval-augmented generation (RAG) to ensure context dense chunks and relevance improvement.
 
-          - Document Intelligence provides a layout model that segments documents into coherent units based on their semantic content.
+          - Document Intelligence provides a layout model that provides a visual decomposition of the document into lines, paragraphs, sections, headers, and footers.
 
-          - You can then export the obtained information to Markdown format, so that you can customize your semantic segmentation strategy based on the available building blocks.
+          - You can then choose to retrieve the results in markdown format, to further chunk the document on section or paragraph boundaries.
 
           For more information, see [overview of RAG in Document Intelligence](concept-retrieval-augmented-generation.md)
 
@@ -288,11 +289,17 @@ sections:
         The copy operation is limited to copying models within the specific cloud environment where you trained the model. For instance, copying models from the public cloud to the Azure Government cloud isn't supported.
 
     - question: |
-        Am I charged when training a custom neural model?
+        Am I charged when training a custom models?
       answer: |
-        **Yes for the first 10 hours only.**
+        **Yes**
 
-        If training hours exceed 10 hours, charges are incurred for further custom neural model training.
+        Although training is free for all custom generative and custom template models, creating the training dataset for all models requires running the Layout model on the training documents. Customers are responsible for this cost. 
+        
+        Custom generative models also rely on the auto label feature to speed up the generation of the labeled dataset. There's a cost associated with this action. While the build operation for template and generative models is free, creating the labeled dataset can result in some minimal costs.
+
+        Custom neural models have a limit on the number of models/the amount of time that models can be trained for free. The first 10 hours of training are free. If training a single model for longer than 10 hours or training multiple models that exceed the 10 hour limit, you need to enable paid training by setting a training budget. See [training a custom neural model](concept-custom-neural.md) for details. 
+        
+        For v3.0 or v3.1 models the paid training tier only applies to added models, the training time per model isn't configurable.
 
   - name: Storage account
     questions:

.openpublishing.redirection.security-center.json

@@ -37,12 +37,10 @@ The Document Intelligence [**2024-07-31-preview**](/rest/api/aiservices/document
 * **West Europe**
 * **North Central US**
 
-* [Read model](concept-read.md) now supports [PDF output](concept-read.md#searchable-pdf)  to download PDFs with embedded text from extraction results, allowing for PDF to be utilized in scenarios such as search and large language model ingestion.
-* [Layout model](concept-layout.md) now supports improved [figure detection](concept-layout.md#figures) where figures from documents can now be downloaded as an image file to be used for further figure understanding.
-* [Custom extraction models](concept-custom.md#custom-extraction-models)
-  * Custom extraction models now support updating the model in-place. 
-* [🆕 Custom generative (Document field extraction) model](concept-custom-generative.md)
-  * Document Intelligence now offers new custom generative model that utilizes generative AI to extract fields from unstructured documents or structured forms with a wide variety of visual templates.
+* [🆕 Document field extraction (custom generative) model](concept-custom-generative.md)
+  * Use **Generative AI** to extract fields from documents and forms. Document Intelligence now offers a new document field extraction model that utilizes large language models (LLMs) to extract fields from unstructured documents or structured forms with a wide variety of visual templates. With grounded values and confidence scores, the new Generative AI based extraction fits into your existing processes.
+* [🆕 Model compose with custom classifiers](concept-composed-models.md)
+  * Document Intelligence now adds support for composing model with an explicit custom classification model. [Learn more about the benefits](concept-composed-models.md) of using the new compose capability.
 * [Custom classification model](concept-custom.md#custom-classification-model)
   * Custom classification model now supports updating the model in-place as well.
   * Custom classification model adds support for model copy operation to enable backup and disaster recovery.
@@ -58,12 +56,14 @@ The Document Intelligence [**2024-07-31-preview**](/rest/api/aiservices/document
   * New prebuilt to extract account information including beginning and ending balances, transaction details from bank statements.​
 * [🆕 US Tax model](concept-tax-document.md)
   * New unified US tax model that can extract from forms such as W-2, 1098, 1099, and 1040.
+* 🆕 Searchable PDF. The [prebuilt read](concept-read.md) model now supports [PDF output](concept-read.md#searchable-pdf)  to download PDFs with embedded text from extraction results, allowing for PDF to be utilized in scenarios such as search copy of contents.
+* [Layout model](concept-layout.md) now supports improved [figure detection](concept-layout.md#figures) where figures from documents can now be downloaded as an image file to be used for further figure understanding. The layout model also features improvements to the OCR model for scanned text targeting improvements for single characters, boxed text, and dense text documents.
+* [🆕 Batch API](concept-batch-analysis.md)
+  * Document Intelligence now adds support for batch analysis operation to support analyzing a set of documents to simplify developer experience and improve efficiency.
 * [Add-on capabilities](concept-add-on-capabilities.md)
   * [Query fields](concept-add-on-capabilities.md#query-fields) AI quality of extraction is improved with the latest model.
-* [🆕 Batch API](concept-batch-analysis.md)
-  * Document Intelligence now adds support for batch analysis operation to support analyzing a set of documents to simplify developer experience and improve service efficiency.
-* [🆕 Model compose with custom classifiers](concept-composed-models.md)
-  * Document Intelligence now adds support for composing model with an explicit custom classification model. 
+
+
 
 ## May 2024
 

articles/ai-services/document-intelligence/concept-read.md

@@ -4,7 +4,7 @@ titleSuffix: Azure OpenAI
 description: Learn about the model deprecations and retirements in Azure OpenAI.
 ms.service: azure-ai-openai
 ms.topic: conceptual
-ms.date: 08/07/2024
+ms.date: 08/08/2024
 ms.custom: 
 manager: nitinme
 author: mrbullwinkle
@@ -90,7 +90,7 @@ These models are currently available for use in Azure OpenAI Service.
 | Model | Version | Retirement date |
 | ---- | ---- | ---- |
 | `gpt-35-turbo` | 0301 | No earlier than October 1, 2024 |
-| `gpt-35-turbo`<br>`gpt-35-turbo-16k` | 0613 | October 1, 2024 |
+| `gpt-35-turbo`<br>`gpt-35-turbo-16k` | 0613 | November 1, 2024 |
 | `gpt-35-turbo` | 1106 | No earlier than Nov 17, 2024 |
 | `gpt-35-turbo` | 0125 | No earlier than Feb 22, 2025 |
 | `gpt-4`<br>`gpt-4-32k` | 0314 | **Deprecation:** October 1, 2024 <br> **Retirement:** June 6, 2025 |
@@ -145,6 +145,10 @@ If you're an existing customer looking for information about these models, see [
 
 ## Retirement and deprecation history
 
+### August 8, 2024
+
+* Updated `gpt-35-turbo` & `gpt-35-turbo-16k` (0613) model's retirement date to November 1, 2024.
+
 ### July 30, 2024
 
 * Updated `gpt-4` preview model upgrade date to November 15, 2024 or later for the following versions: