Skip to content

Commit cf8446d

Browse files
authored
Merge pull request #607 from MicrosoftDocs/main
10/01 OOB Publish
2 parents b0599a2 + 2be1827 commit cf8446d

File tree

11 files changed

+201
-150
lines changed

11 files changed

+201
-150
lines changed

articles/ai-services/document-intelligence/containers/install-run.md

Lines changed: 12 additions & 17 deletions
Original file line numberDiff line numberDiff line change
@@ -5,10 +5,8 @@ description: Use the Docker containers for Document Intelligence on-premises to
55
author: laujan
66
manager: nitinme
77
ms.service: azure-ai-document-intelligence
8-
ms.custom:
9-
- ignite-2023
108
ms.topic: how-to
11-
ms.date: 07/09/2024
9+
ms.date: 10/01/2024
1210
ms.author: lajanuar
1311
---
1412

@@ -18,30 +16,27 @@ ms.author: lajanuar
1816
<!-- markdownlint-disable MD024 -->
1917
<!-- markdownlint-disable MD051 -->
2018

21-
:::moniker range="doc-intel-2.1.0 || doc-intel-4.0.0"
22-
Support for containers is currently available with Document Intelligence version `2022-08-31 (GA)` for all models and `2023-07-31 (GA)` for Read, Layout, ID Document, Receipt, and Invoice models:
23-
24-
* [REST API `2022-08-31 (GA)`](/rest/api/aiservices/document-models/analyze-document?view=rest-aiservices-v3.0%20(2022-08-31)&preserve-view=true&tabs=HTTP)
25-
* [REST API `2023-07-31 (GA)`](/rest/api/aiservices/document-models/analyze-document?view=rest-aiservices-v3.1%20(2023-07-31)&tabs=HTTP&preserve-view=true)
26-
* [Client libraries targeting `REST API 2022-08-31 (GA)`](../sdk-overview-v3-0.md)
27-
* [Client libraries targeting `REST API 2023-07-31 (GA)`](../sdk-overview-v3-1.md)
28-
29-
✔️ See [**Install and run Document Intelligence containers**](?view=doc-intel-3.1.0&preserve-view=true) for supported container documentation.
30-
31-
:::moniker-end
32-
33-
:::moniker range="doc-intel-3.0.0 || doc-intel-3.1.0"
19+
:::moniker range=">=doc-intel-2.1.0"
3420

3521
**This content applies to:** ![checkmark](../media/yes-icon.png) **v3.0 (GA)** ![checkmark](../media/yes-icon.png) **v3.1 (GA)**
3622

3723
Azure AI Document Intelligence is an Azure AI service that lets you build automated data processing software using machine-learning technology. Document Intelligence enables you to identify and extract text, key/value pairs, selection marks, table data, and more from your documents. The results are delivered as structured data that ../includes the relationships in the original file.
3824

39-
In this article you learn how to download, install, and run Document Intelligence containers. Containers enable you to run the Document Intelligence service in your own environment. Containers are great for specific security and data governance requirements.
25+
In this article you can learn how to download, install, and run Document Intelligence containers. Containers enable you to run the Document Intelligence service in your own environment. Containers are great for specific security and data governance requirements.
4026

4127
* **Read**, **Layout**, **ID Document**, **Receipt**, and **Invoice** models are supported by Document Intelligence v3.1 containers.
4228

4329
* **Read**, **Layout**, **General Document**, **Business Card**, and **Custom** models are supported by Document Intelligence v3.0 containers.
4430

31+
## Version support
32+
33+
Support for containers is currently available with Document Intelligence version `v3.0: 2022-08-31 (GA)` for all models and `v3.1 2023-07-31 (GA)` for Read, Layout, ID Document, Receipt, and Invoice models:
34+
35+
* [REST API `v3.0: 2022-08-31 (GA)`](/rest/api/aiservices/document-models/analyze-document?view=rest-aiservices-v3.0%20(2022-08-31)&preserve-view=true&tabs=HTTP)
36+
* [REST API `v3.1: 2023-07-31 (GA)`](/rest/api/aiservices/document-models/analyze-document?view=rest-aiservices-v3.1%20(2023-07-31)&tabs=HTTP&preserve-view=true)
37+
* [Client libraries targeting `REST API v3.0: 2022-08-31 (GA)`](../sdk-overview-v3-0.md)
38+
* [Client libraries targeting `REST API v3.1: 2023-07-31 (GA)`](../sdk-overview-v3-1.md)
39+
4540
## Prerequisites
4641

4742
To get started, you need an active [**Azure account**](https://azure.microsoft.com/free/cognitive-services/). If you don't have one, you can [**create a free account**](https://azure.microsoft.com/free/).

articles/ai-services/openai/concepts/content-filter.md

Lines changed: 20 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -84,6 +84,25 @@ Detecting indirect attacks requires using document delimiters when constructing
8484
[!INCLUDE [content-filter-configurability](../includes/content-filter-configurability.md)]
8585

8686

87+
<sup>1</sup> For Azure OpenAI models, only customers who have been approved for modified content filtering have full content filtering control and can turn off content filters. Apply for modified content filters via this form: [Azure OpenAI Limited Access Review: Modified Content Filters](https://ncv.microsoft.com/uEfCgnITdR) For Azure Government customers, please apply for modified content filters via this form: [Azure Government - Request Modified Content Filtering for Azure OpenAI Service](https://aka.ms/AOAIGovModifyContentFilter).
88+
89+
Configurable content filters for inputs (prompts) and outputs (completions) are available for the following Azure OpenAI models:
90+
91+
* GPT model series
92+
* GPT-4 Turbo Vision GA<sup>*</sup> (turbo-2024-04-09)
93+
* GPT-4o
94+
* GPT-4o mini
95+
* DALL-E 2 and 3
96+
97+
Configurable content filters are currently not available for
98+
99+
`o1-preview` and `o1-mini`
100+
101+
<sup>*</sup>Only available for GPT-4 Turbo Vision GA, does not apply to GPT-4 Turbo Vision preview
102+
103+
Content filtering configurations are created within a Resource in Azure AI Studio, and can be associated with Deployments. [Learn more about configurability here](../how-to/content-filters.md).
104+
105+
Customers are responsible for ensuring that applications integrating Azure OpenAI comply with the [Code of Conduct](/legal/cognitive-services/openai/code-of-conduct?context=%2Fazure%2Fai-services%2Fopenai%2Fcontext%2Fcontext).
87106

88107
## Scenario details
89108

@@ -1012,4 +1031,4 @@ As part of your application design, consider the following best practices to del
10121031
- Apply for modified content filters via [this form](https://ncv.microsoft.com/uEfCgnITdR).
10131032
- Azure OpenAI content filtering is powered by [Azure AI Content Safety](https://azure.microsoft.com/products/cognitive-services/ai-content-safety).
10141033
- Learn more about understanding and mitigating risks associated with your application: [Overview of Responsible AI practices for Azure OpenAI models](/legal/cognitive-services/openai/overview?context=/azure/ai-services/openai/context/context).
1015-
- Learn more about how data is processed in connection with content filtering and abuse monitoring: [Data, privacy, and security for Azure OpenAI Service](/legal/cognitive-services/openai/data-privacy?context=/azure/ai-services/openai/context/context#preventing-abuse-and-harmful-content-generation).
1034+
- Learn more about how data is processed in connection with content filtering and abuse monitoring: [Data, privacy, and security for Azure OpenAI Service](/legal/cognitive-services/openai/data-privacy?context=/azure/ai-services/openai/context/context#preventing-abuse-and-harmful-content-generation).

articles/ai-services/openai/concepts/models.md

Lines changed: 11 additions & 8 deletions
Original file line numberDiff line numberDiff line change
@@ -4,7 +4,7 @@ titleSuffix: Azure OpenAI
44
description: Learn about the different model capabilities that are available with Azure OpenAI.
55
ms.service: azure-ai-openai
66
ms.topic: conceptual
7-
ms.date: 09/30/2024
7+
ms.date: 10/01/2024
88
ms.custom: references_regions, build-2023, build-2023-dataai, refefences_regions
99
manager: nitinme
1010
author: mrbullwinkle #ChrisHMSFT
@@ -33,16 +33,17 @@ The Azure OpenAI `o1-preview` and `o1-mini` models are specifically designed to
3333

3434
### Availability
3535

36-
The `o1-preview` and `o1-mini` models are available in the East US2 region for limited access through the [AI Studio](https://ai.azure.com) early access playground. Data processing for the `o1` models may occur in a different region than where they are available for use.
37-
38-
To try the `o1-preview` and `o1-mini` models in the early access playground, **registration is required, and access will be granted based on Microsoft’s eligibility criteria**.
36+
The `o1-preview` and `o1-mini` models are now available for API access and model deployment. **Registration is required, and access will be granted based on Microsoft's eligibility criteria**.
3937

4038
Request access: [limited access model application](https://aka.ms/oai/modelaccess)
4139

42-
Once access has been granted, you will need to:
40+
Once access has been granted, you will need to create a deployment for each model.
41+
42+
### API support
43+
44+
Support for the **o1 series** models was added in API version `2024-09-01-preview`.
4345

44-
1. Navigate to https://ai.azure.com/resources and select a resource in the `eastus2` region. If you do not have an Azure OpenAI resource in this region you will need to [create one](https://portal.azure.com/#create/Microsoft.CognitiveServicesOpenAI).
45-
2. Once the `eastus2` Azure OpenAI resource is selected, in the upper left-hand panel under **Playgrounds** select **Early access playground (preview)**.
46+
The `max_tokens` parameter has been deprecated and replaced with the new `max_completion_tokens` parameter. **o1 series** models will only work with the `max_completions_tokens` parameter.
4647

4748
## GPT-4o audio
4849

@@ -98,6 +99,8 @@ See [model versions](../concepts/model-versions.md) to learn about how Azure Ope
9899

99100
| Model ID | Description | Max Request (tokens) | Training Data (up to) |
100101
| --- | :--- |:--- |:---: |
102+
|`o1-preview` (2024-09-12) | The most capable model in the o1 series, offering enhanced reasoning abilities.| Input: 128,000 <br> Output: 32,768 | Oct 2023 |
103+
| `o1-mini` (2024-09-12) | A faster and more cost-efficient option in the o1 series, ideal for coding tasks requiring speed and lower resource consumption.| Input: 128,000 <br> Output: 65,536 | Oct 2023 |
101104
|`gpt-4o` (2024-08-06) <br> **GPT-4o (Omni)** | **Latest large GA model** <br> - Structured outputs<br> - Text, image processing <br> - JSON Mode <br> - parallel function calling <br> - Enhanced accuracy and responsiveness <br> - Parity with English text and coding tasks compared to GPT-4 Turbo with Vision <br> - Superior performance in non-English languages and in vision tasks |Input: 128,000 <br> Output: 16,384 | Oct 2023 |
102105
|`gpt-4o-mini` (2024-07-18) <br> **GPT-4o mini** | **Latest small GA model** <br> - Fast, inexpensive, capable model ideal for replacing GPT-3.5 Turbo series models. <br> - Text, image processing <br>- JSON Mode <br> - parallel function calling | Input: 128,000 <br> Output: 16,384 | Oct 2023 |
103106
|`gpt-4o` (2024-05-13) <br> **GPT-4o (Omni)** | Text, image processing <br> - JSON Mode <br> - parallel function calling <br> - Enhanced accuracy and responsiveness <br> - Parity with English text and coding tasks compared to GPT-4 Turbo with Vision <br> - Superior performance in non-English languages and in vision tasks |Input: 128,000 <br> Output: 4,096| Oct 2023 |
@@ -421,4 +424,4 @@ For the latest information on model retirements, refer to the [model retirement
421424
- [Model retirement and deprecation](./model-retirements.md)
422425
- [Learn more about working with Azure OpenAI models](../how-to/working-with-models.md)
423426
- [Learn more about Azure OpenAI](../overview.md)
424-
- [Learn more about fine-tuning Azure OpenAI models](../how-to/fine-tuning.md)
427+
- [Learn more about fine-tuning Azure OpenAI models](../how-to/fine-tuning.md)

articles/ai-services/openai/how-to/audio-real-time.md

Lines changed: 22 additions & 13 deletions
Original file line numberDiff line numberDiff line change
@@ -1,7 +1,7 @@
11
---
2-
title: 'How to use GPT-4o real-time audio with Azure OpenAI Service'
2+
title: 'How to use GPT-4o Realtime API for speech and audio with Azure OpenAI Service'
33
titleSuffix: Azure OpenAI
4-
description: Learn how to use GPT-4o real-time audio with Azure OpenAI Service.
4+
description: Learn how to use GPT-4o Realtime API for speech and audio with Azure OpenAI Service.
55
manager: nitinme
66
ms.service: azure-ai-openai
77
ms.topic: how-to
@@ -12,11 +12,11 @@ ms.custom: references_regions
1212
recommendations: false
1313
---
1414

15-
# GPT-4o real-time audio
15+
# GPT-4o Realtime API for speech and audio
1616

17-
Azure OpenAI GPT-4o audio is part of the GPT-4o model family that supports low-latency, "speech in, speech out" conversational interactions. The GPT-4o audio `realtime` API is designed to handle real-time, low-latency conversational interactions, making it a great fit for use cases involving live interactions between a user and a model, such as customer support agents, voice assistants, and real-time translators.
17+
Azure OpenAI GPT-4o Realtime API for speech and audio is part of the GPT-4o model family that supports low-latency, "speech in, speech out" conversational interactions. The GPT-4o audio `realtime` API is designed to handle real-time, low-latency conversational interactions, making it a great fit for use cases involving live interactions between a user and a model, such as customer support agents, voice assistants, and real-time translators.
1818

19-
Most users of this API need to deliver and receive audio from an end-user in real time, including applications that use WebRTC or a telephony system. The real-time API isn't designed to connect directly to end user devices and relies on client integrations to terminate end user audio streams.
19+
Most users of this API need to deliver and receive audio from an end-user in real time, including applications that use WebRTC or a telephony system. The Realtime API isn't designed to connect directly to end user devices and relies on client integrations to terminate end user audio streams.
2020

2121
## Supported models
2222

@@ -29,7 +29,7 @@ The `gpt-4o-realtime-preview` model is available for global deployments in [East
2929
3030
## API support
3131

32-
Support for real-time audio was first added in API version `2024-10-01-preview`.
32+
Support for the Realtime API was first added in API version `2024-10-01-preview`.
3333

3434
> [!NOTE]
3535
> For more information about the API and architecture, see the [Azure OpenAI GPT-4o real-time audio repository on GitHub](https://github.com/azure-samples/aoai-realtime-audio-sdk).
@@ -56,15 +56,18 @@ You can deploy the model from the Azure OpenAI model catalog or from your projec
5656

5757
Now that you have a deployment of the `gpt-4o-realtime-preview` model, you can use the playground to interact with the model in real time. Select **Early access playground** from the list of playgrounds in the left pane.
5858

59-
## Use the GPT-4o real-time audio API
59+
## Use the GPT-4o Realtime API
6060

6161
> [!TIP]
6262
> A playground for GPT-4o real-time audio is coming soon to [Azure AI Studio](https://ai.azure.com). You can already use the API directly in your application.
6363
64-
Right now, the fastest way to get started with GPT-4o real-time audio is to download the sample code from the [Azure OpenAI GPT-4o real-time audio repository on GitHub](https://github.com/azure-samples/aoai-realtime-audio-sdk).
64+
Right now, the fastest way to get started with the GPT-4o Realtime API is to download the sample code from the [Azure OpenAI GPT-4o real-time audio repository on GitHub](https://github.com/azure-samples/aoai-realtime-audio-sdk).
65+
66+
The JavaScript web sample demonstrates how to use the GPT-4o Realtime API to interact with the model in real time. The sample code includes a simple web interface that captures audio from the user's microphone and sends it to the model for processing. The model responds with text and audio, which the sample code renders in the web interface.
67+
68+
You can run the sample code locally on your machine by following these steps. Refer to the [repository on GitHub](https://github.com/azure-samples/aoai-realtime-audio-sdk) for the most up-to-date instructions.
69+
1. If you don't have Node.js installed, download and install the [LTS version of Node.js](https://nodejs.org/).
6570

66-
The JavaScript web sample demonstrates how to use the GPT-4o real-time audio API to interact with the model in real time. The sample code includes a simple web interface that captures audio from the user's microphone and sends it to the model for processing. The model responds with text and audio, which the sample code renders in the web interface.
67-
6871
1. Clone the repository to your local machine:
6972

7073
```bash
@@ -74,12 +77,18 @@ The JavaScript web sample demonstrates how to use the GPT-4o real-time audio API
7477
1. Go to the `javascript/samples/web` folder in your preferred code editor.
7578

7679
```bash
77-
cd .\javascript\samples\web\
80+
cd ./javascript/samples
7881
```
7982

80-
1. If you don't have Node.js installed, download and install the [LTS version of Node.js](https://nodejs.org/).
83+
1. Run `download-pkg.ps1` or `download-pkg.sh` to download the required packages.
84+
85+
1. Go to the `web` folder from the `./javascript/samples` folder.
86+
87+
```bash
88+
cd ./web
89+
```
8190

82-
1. Run `npm install` to download a few dependency packages. For more information, see the `package.json` file in the same `web` folder.
91+
1. Run `npm install` to install package dependencies.
8392

8493
1. Run `npm run dev` to start the web server, navigating any firewall permissions prompts as needed.
8594
1. Go to any of the provided URIs from the console output (such as `http://localhost:5173/`) in a browser.

articles/ai-services/openai/overview.md

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -14,13 +14,13 @@ recommendations: false
1414

1515
# What is Azure OpenAI Service?
1616

17-
Azure OpenAI Service provides REST API access to OpenAI's powerful language models including GPT-4o, GPT-4o mini, GPT-4 Turbo with Vision, GPT-4, GPT-3.5-Turbo, and Embeddings model series. These models can be easily adapted to your specific task including but not limited to content generation, summarization, image understanding, semantic search, and natural language to code translation. Users can access the service through REST APIs, Python SDK, or our web-based interface in the Azure OpenAI Studio.
17+
Azure OpenAI Service provides REST API access to OpenAI's powerful language models including o1-preview, o1-mini, GPT-4o, GPT-4o mini, GPT-4 Turbo with Vision, GPT-4, GPT-3.5-Turbo, and Embeddings model series. These models can be easily adapted to your specific task including but not limited to content generation, summarization, image understanding, semantic search, and natural language to code translation. Users can access the service through REST APIs, Python SDK, or our web-based interface in the Azure OpenAI Studio.
1818

1919
### Features overview
2020

2121
| Feature | Azure OpenAI |
2222
| --- | --- |
23-
| Models available | **GPT-4o & GPT-4o mini**<br> **GPT-4 series (including GPT-4 Turbo with Vision)** <br>**GPT-3.5-Turbo series**<br> Embeddings series <br> Learn more in our [Models](./concepts/models.md) page.|
23+
| Models available | **o1-preview** & **o1-mini** - (Limited Access - [Request Access](https://aka.ms/oai/modelaccess))<br>**GPT-4o & GPT-4o mini**<br> **GPT-4 series (including GPT-4 Turbo with Vision)** <br>**GPT-3.5-Turbo series**<br> Embeddings series <br> Learn more in our [Models](./concepts/models.md) page.|
2424
| Fine-tuning | `GPT-4o-mini` (preview) <br> `GPT-4` (preview) <br>`GPT-3.5-Turbo` (0613) <br> `babbage-002` <br> `davinci-002`.|
2525
| Price | [Available here](https://azure.microsoft.com/pricing/details/cognitive-services/openai-service/) <br> For details on GPT-4 Turbo with Vision, see the [special pricing information](../openai/concepts/gpt-with-vision.md#special-pricing-information).|
2626
| Virtual network support & private link support | Yes, unless using [Azure OpenAI on your data](./concepts/use-your-data.md). |
@@ -125,4 +125,4 @@ Learn more about each model on our [models concept page](./concepts/models.md).
125125

126126
## Next steps
127127

128-
Learn more about the [underlying models that power Azure OpenAI](./concepts/models.md).
128+
Learn more about the [underlying models that power Azure OpenAI](./concepts/models.md).

articles/ai-services/openai/quotas-limits.md

Lines changed: 20 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -60,6 +60,26 @@ The following sections provide you with a quick guide to the default quotas and
6060

6161
[!INCLUDE [Quota](./includes/global-batch-limits.md)]
6262

63+
## o1-preview & o1-mini rate limits
64+
65+
### o1-preview & o1-mini global standard
66+
67+
| Model|Tier| Quota Limit in tokens per minute (TPM) | Requests per minute |
68+
|---|---|:---:|:---:|
69+
| `o1-preview` | Enterprise agreement | 15 M | 2.5 K |
70+
| `o1-mini`| Enterprise agreement | 50 M | 5 K |
71+
| `o1-preview` | Default | 1.5 M | 250 |
72+
| `o1-mini`| Default | 20 M | 2 K |
73+
74+
### o1-preview & o1-mini standard
75+
76+
| Model|Tier| Quota Limit in tokens per minute (TPM) | Requests per minute |
77+
|---|---|:---:|:---:|
78+
| `o1-preview` | Enterprise agreement | 300 K | 50 |
79+
| `o1-mini`| Enterprise agreement | 1 M | 100 |
80+
| `o1-preview` | Default | 300 K | 50 |
81+
| `o1-mini`| Default | 1 M | 100 |
82+
6383
## gpt-4o & GPT-4 Turbo rate limits
6484

6585
`gpt-4o` and `gpt-4o-mini`, and `gpt-4` (`turbo-2024-04-09`) have rate limit tiers with higher limits for certain customer types.

0 commit comments

Comments
 (0)