Merge pull request #595 from MicrosoftDocs/main

[Azure OpenAI] main to live tracking PR

Author: Daidihuang

articles/ai-services/content-safety/limited-access.md

@@ -12,12 +12,12 @@ ms.date: 09/23/2024
 
 # Limited Access to Content Safety features
 
-The Azure AI Content Safety [containers](./how-to/containers/container-overview.md) and [embedded SDK](./how-to/embedded-content-safety.md) allow for on-device analysis where cloud connectivity is intermittent or unavailable. They are Limited Access features available by registration only, and only for certain use cases.
+The Azure AI Content Safety [disconnected containers](./how-to/containers/container-overview.md) and [embedded SDK](./how-to/embedded-content-safety.md) allow for on-device analysis where cloud connectivity is intermittent or unavailable. They are Limited Access features available by registration only, and only for certain use cases.
 
 ## Registration process
 
-The content safety containers and embedded SDK require registration. Only customers managed by Microsoft, meaning those who are working directly with Microsoft account teams, are eligible for access. Customers who wish to use this feature are required to register by submitting a registration form. The use of either feature is limited to the use case selected at the time of registration. Microsoft may require customers to re-verify this information.
-- [Request access to content safety containers](https://aka.ms/csdisconnectedcontainers)
+The content safety disconnected containers and embedded SDK require registration. Only customers managed by Microsoft, meaning those who are working directly with Microsoft account teams, are eligible for access. Customers who wish to use this feature are required to register by submitting a registration form. The use of either feature is limited to the use case selected at the time of registration. Microsoft may require customers to re-verify this information.
+- [Request access to content safety disconnected containers](https://aka.ms/csdisconnectedcontainers)
 - [Request access to embedded content safety](https://aka.ms/aacs-embedded-application)
 
 These features are available to customers under the terms governing their subscription to Microsoft Azure Services (including the [Service Specific Terms](https://go.microsoft.com/fwlink/?linkid=2018760)). Please review these terms carefully as they contain important conditions and obligations governing your use of the service.

articles/ai-services/content-safety/overview.md

@@ -144,27 +144,44 @@ To use the Content Safety APIs, you must create your Azure AI Content Safety res
 
 | Region   | Moderation APIs (text and image) | Moderation APIs (multimodal) | Prompt Shields | Protected material detection for Text | Protected material detection for Code | Groundedness detection (preview) | Custom categories (rapid) (preview) | Custom categories (standard) (preview) | Blocklists |  
 |--|-|---|-|--|---|-|-|---|---|  
-| East US        | ✅    | ✅    | ✅  | ✅    |   ✅ | ✅    | ✅   | ✅ | ✅  |  
-| East US 2      | ✅    |  | ✅  | ✅    |  ✅  | ✅    | ✅   |   | ✅  |  
-| West US        |  |  | ✅  | ✅    |  ✅  |    | ✅   |   |    |  
-| West US 2      | ✅    |  | ✅  | ✅    |  ✅  |    | ✅   |   | ✅  |  
-| West US 3      | ✅    |  | ✅  | ✅    | ✅   |    | ✅   |   | ✅  |  
-| Poland Central  | ✅  |  | ✅  | ✅    |  ✅  |    | ✅   |   | ✅  |  
-| South East Asia | ✅ |  | ✅  | ✅    |   ✅ |    | ✅   |   | ✅  |  
-| Central US      | ✅    |  |    | ✅    | ✅  |    | ✅   |   | ✅  |  
-| North Central US | ✅    |  | ✅  | ✅    | ✅   |    | ✅   |   | ✅  |  
-| South Central US | ✅    |  | ✅  | ✅    | ✅   |    | ✅   |   | ✅  |  
-| Canada East      | ✅    |  | ✅  | ✅    | ✅   |    | ✅   |   | ✅  |  
-| Switzerland North | ✅   |  | ✅  | ✅    |  ✅  |    | ✅   | ✅ | ✅  |  
-| Sweden Central | ✅  |  | ✅  | ✅    |  ✅  | ✅    | ✅   |   | ✅  |  
-| UK South       | ✅    |  | ✅  | ✅    | ✅   |    | ✅   |   | ✅  |  
-| France Central | ✅  |  | ✅  | ✅    | ✅   |    | ✅   |   | ✅  |  
-| West Europe    | ✅    | ✅    | ✅  | ✅    |   ✅ |    | ✅   |   | ✅  |  
-| Japan East     | ✅    |  | ✅  | ✅    |  ✅  |    | ✅   |   | ✅  |  
-| Australia East | ✅  |  | ✅  | ✅    |  ✅  |    | ✅   | ✅ | ✅  |  
-| South India    | ✅    |  |    | ✅    | ✅   |    | ✅   |   | ✅  |  
-| USGov Arizona  | ✅   |  |    |  |    |    |   |   | ✅  |  
-| USGov Virginia | ✅  |  |    |  |    |    |   |   | ✅  |
+| East US           | ✅  |✅| ✅  | ✅    |  ✅ | ✅ | ✅   | ✅ | ✅  |  
+| East US 2         | ✅  |   | ✅ | ✅    |  ✅  | ✅| ✅    |   | ✅   |  
+| Central US        | ✅  |  |      | ✅     | ✅  |    | ✅   |   | ✅   |  
+| North Central US  | ✅  |  | ✅  | ✅    | ✅   |    | ✅   |   | ✅  |  
+| South Central US  | ✅  |  | ✅  | ✅    | ✅   |    | ✅   |   | ✅  |  
+| West US           |      |  | ✅  | ✅   |  ✅  |    | ✅   |   |       |  
+| West US 2         | ✅  |  | ✅  | ✅    |  ✅  |    | ✅   |   | ✅  |  
+| West US 3         | ✅  |  | ✅  | ✅    | ✅   |    | ✅   |   | ✅  |  
+| Canada East       | ✅  |  | ✅  | ✅    | ✅   |    | ✅   |   | ✅  |  
+| Canada Central    |✅   |  | ✅  |✅     | ✅   |    |      |   |       |
+| Brazil South      |  ✅ |  |  ✅|    ✅  |  ✅  |    |      |   |       |
+| Switzerland North | ✅  |  | ✅  | ✅    |  ✅  |    | ✅   | ✅ | ✅  |  
+| Germany West Central|✅|  | ✅|   ✅  |  ✅  |    |      |   |       |
+| Poland Central    | ✅  |  | ✅  | ✅     |  ✅  |    | ✅   |   | ✅  |  
+| Sweden Central    | ✅  |  | ✅  | ✅    |  ✅  | ✅| ✅    |  | ✅   |  
+| Norway East       |✅   |  | ✅ | ✅    |   ✅  |    |      |   |       |
+| UK South          | ✅  |  | ✅  | ✅    | ✅   |    | ✅   |   | ✅  |  
+| France Central    | ✅  |  |     | ✅    | ✅   |    | ✅   |   | ✅  |  
+| West Europe       | ✅  |✅| ✅ | ✅    |   ✅ |    | ✅   |   | ✅   |  
+| Italy North       |      |  | ✅| ✅    | ✅   |    |      |   |       |
+| India North       |      |  |✅ |✅     | ✅   |    |       |   |      |
+| South India       | ✅  |  |     | ✅    | ✅   |    | ✅     |   | ✅  |  
+| Central India     |     |   | ✅ |   ✅  | ✅   |     |       |   |      |
+| South East Asia   |      |  | ✅  | ✅   |   ✅ |    | ✅   |   | ✅  |  
+| Japan East        | ✅  |  | ✅  | ✅    |  ✅  |    | ✅   |   | ✅   |  
+| Japan West        |      |  | ✅|  ✅   |  ✅  |    | ✅   |   |       |
+| Korea Central     |  ✅ |  |    |         |       |    |      |   |       |
+| Australia East    | ✅  |  | ✅  | ✅    |  ✅  |     | ✅  | ✅| ✅   |  
+| UAE North         |   ✅|  |     |        |      |     |      |   |       |
+| South Africa North|   ✅|  | ✅ |   ✅   |  ✅  |    |      |   |       |
+| USGov Arizona     | ✅  |  |     |        |      |    |       |   | ✅   |  
+| USGov Virginia    | ✅  |  |     |        |      |    |       |   | ✅   |
+
+
+
+
+
+
 
 Feel free to [contact us](mailto:[email protected]) if your business needs other regions to be available.
 

articles/ai-services/openai/concepts/models.md

@@ -4,7 +4,7 @@ titleSuffix: Azure OpenAI
 description: Learn about the different model capabilities that are available with Azure OpenAI.
 ms.service: azure-ai-openai
 ms.topic: conceptual
-ms.date: 09/12/2024
+ms.date: 09/30/2024
 ms.custom: references_regions, build-2023, build-2023-dataai, refefences_regions
 manager: nitinme
 author: mrbullwinkle #ChrisHMSFT
@@ -19,6 +19,7 @@ Azure OpenAI Service is powered by a diverse set of models with different capabi
 | Models | Description |
 |--|--|
 | [GPT-4o & GPT-4o mini & GPT-4 Turbo](#gpt-4o-and-gpt-4-turbo) | The latest most capable Azure OpenAI models with multimodal versions, which can accept both text and images as input. |
+| [GPT-4o audio](#gpt-4o-audio) | A GPT-4o model that supports low-latency, "speech in, speech out" conversational interactions. |
 | [GPT-4](#gpt-4) | A set of models that improve on GPT-3.5 and can understand and generate natural language and code. |
 | [GPT-3.5](#gpt-35) | A set of models that improve on GPT-3 and can understand and generate natural language and code. |
 | [Embeddings](#embeddings-models) | A set of models that can convert text into numerical vector form to facilitate text similarity. |
@@ -43,6 +44,20 @@ Once access has been granted, you will need to:
 1. Navigate to https://ai.azure.com/resources and select a resource in the `eastus2` region. If you do not have an Azure OpenAI resource in this region you will need to [create one](https://portal.azure.com/#create/Microsoft.CognitiveServicesOpenAI).  
 2. Once the `eastus2` Azure OpenAI resource is selected, in the upper left-hand panel under **Playgrounds** select **Early access playground (preview)**.
 
+## GPT-4o audio
+
+The `gpt-4o-realtime-preview` model is part of the GPT-4o model family and supports low-latency, "speech in, speech out" conversational interactions. GPT-4o audio is designed to handle real-time, low-latency conversational interactions, making it a great fit for support agents, assistants, translators, and other use cases that need highly responsive back-and-forth with a user.
+
+GPT-4o audio is available in the East US 2 (`eastus2`) and Sweden Central (`swedencentral`) regions. To use GPT-4o audio, you need to [create](../how-to/create-resource.md) or use an existing resource in one of the supported regions.
+
+When your resource is created, you can [deploy](../how-to/create-resource.md#deploy-a-model) the GPT-4o audio model. If you are performing a programmatic deployment, the **model** name is `gpt-4o-realtime-preview`. For more information on how to use GPT-4o audio, see the [GPT-4o audio documentation](../how-to/audio-real-time.md).
+
+Details about maximum request tokens and training data are available in the following table.
+
+|  Model ID  | Description | Max Request (tokens) | Training Data (up to)  |
+|  --- |  :--- |:--- |:---: |
+|`gpt-4o-realtime-preview` (2024-10-01-preview) <br> **GPT-4o audio** | **Audio model** for real-time audio processing |Input: 128,000  <br> Output: 4,096 | Oct 2023 |
+
 ## GPT-4o and GPT-4 Turbo
 
 GPT-4o integrates text and images in a single model, enabling it to handle multiple data types simultaneously. This multimodal approach enhances accuracy and responsiveness in human-computer interactions. GPT-4o matches GPT-4 Turbo in English text and coding tasks while offering superior performance in non-English languages and vision tasks, setting new benchmarks for AI capabilities.
@@ -96,15 +111,17 @@ See [model versions](../concepts/model-versions.md) to learn about how Azure Ope
 | `gpt-4` (0314) | **Older GA model** <br> - [Retirement information](./model-retirements.md#current-models)  | 8,192 | Sep 2021         |
 
 > [!CAUTION]
-> We don't recommend using preview models in production. We will upgrade all deployments of preview models to either future preview versions or to the latest stable/GA version. Models designated preview do not follow the standard Azure OpenAI model lifecycle.
+> We don't recommend using preview models in production. We will upgrade all deployments of preview models to either future preview versions or to the latest stable GA version. Models designated preview do not follow the standard Azure OpenAI model lifecycle.
 
 - GPT-4 version 0125-preview is an updated version of the GPT-4 Turbo preview previously released as version 1106-preview.  
 - GPT-4 version 0125-preview completes tasks such as code generation more completely compared to gpt-4-1106-preview. Because of this, depending on the task, customers may find that GPT-4-0125-preview generates more output compared to the gpt-4-1106-preview.  We recommend customers compare the outputs of the new model.  GPT-4-0125-preview also addresses bugs in gpt-4-1106-preview with UTF-8 handling for non-English languages. 
 - GPT-4 version `turbo-2024-04-09` is the latest GA release and replaces `0125-Preview`, `1106-preview`, and `vision-preview`.
 
 > [!IMPORTANT]
->
-> - `gpt-4` versions 1106-Preview, 0125-Preview, and vision-preview will be upgraded with a stable version of `gpt-4` in the future. Deployments of `gpt-4` versions 1106-Preview, 0125-Preview, and vision-preview set to "Auto-update to default" and "Upgrade when expired" will start to be upgraded after the stable version is released. For each deployment, a model version upgrade takes place with no interruption in service for API calls.  Upgrades are staged by region and the full upgrade process is expected to take 2 weeks. Deployments of `gpt-4` versions 1106-Preview, 0125-Preview, and vision-preview set to "No autoupgrade" will not be upgraded and will stop operating when the preview version is upgraded in the region. See [Azure OpenAI model retirements and deprecations](./model-retirements.md) for more information on the timing of the upgrade.
+> The GPT-4 (`gpt-4`) versions `1106-Preview`, `0125-Preview`, and `vision-preview` will be upgraded with a stable version of `gpt-4` in the future. 
+> - Deployments of `gpt-4` versions `1106-Preview`, `0125-Preview`, and `vision-preview` set to "Auto-update to default" and "Upgrade when expired" will start to be upgraded after the stable version is released. For each deployment, a model version upgrade takes place with no interruption in service for API calls. Upgrades are staged by region and the full upgrade process is expected to take 2 weeks. 
+> - Deployments of `gpt-4` versions  `1106-Preview`, `0125-Preview`, and `vision-preview` set to "No autoupgrade" will not be upgraded and will stop operating when the preview version is upgraded in the region. 
+> See [Azure OpenAI model retirements and deprecations](./model-retirements.md) for more information on the timing of the upgrade.
 
 ## GPT-3.5