Skip to content

Commit c4bd65f

Browse files
v-ccolinv-ccolin
authored
Merge pull request #275978 from mrbullwinkle/mrb_05_21_2024_fine_tuning_quota
[Azure OpenAI] GPT-4 Fine-tuning quota update autogen docs
2 parents 4f3b237 + ee5018c commit c4bd65f

File tree

1 file changed

+22
-22
lines changed
  • articles/ai-services/openai/includes/model-matrix

1 file changed

+22
-22
lines changed

‎articles/ai-services/openai/includes/model-matrix/quota.md

Lines changed: 22 additions & 22 deletions
Original file line numberDiff line numberDiff line change
@@ -5,34 +5,34 @@ description: Quota and limits for Azure OpenAI by region.
55
manager: nitinme
66
ms.service: azure-ai-openai
77
ms.topic: include
8-
ms.date: 05/18/2024
8+
ms.date: 05/21/2024
99
---
1010

1111
The default quota for models varies by model and region. Default quota limits are subject to change.
1212

1313
Quota for standard deployments is described in of terms of [Tokens-Per-Minute (TPM)](../../how-to/quota.md).
1414

15-
| Region | GPT-4 | GPT-4-32K | GPT-4-Turbo | GPT-4-Turbo-V | gpt-4o | gpt-4o - GlobalStandard | GPT-35-Turbo | GPT-35-Turbo-Instruct | Text-Embedding-Ada-002 | text-embedding-3-small | text-embedding-3-large | Babbage-002 | Babbage-002 - finetune | Davinci-002 | Davinci-002 - finetune | GPT-35-Turbo - finetune | GPT-35-Turbo-1106 - finetune | GPT-35-Turbo-0125 - finetune |
16-
|:-----------------|:-------:|:-----------:|:-------------:|:---------------:|:--------:|:-------------------------:|:--------------:|:-----------------------:|:------------------------:|:------------------------:|:------------------------:|:-------------:|:------------------------:|:-------------:|:------------------------:|:-------------------------:|:------------------------------:|:-------------------------------|
17-
| australiaeast | 40 K | 80 K | 80 K | 30 K | - | - | 300 K | - | 350 K | - | - | - | - | - | - | - | - | - |
18-
| brazilsouth | - | - | - | - | - | - | - | - | 350 K | - | - | - | - | - | - | - | - | - |
19-
| canadaeast | 40 K | 80 K | 80 K | - | - | - | 300 K | - | 350 K | 350 K | 350 K | - | - | - | - | - | - | - |
20-
| eastus | - | - | 80 K | - | 150 K | 450 K | 240 K | 240 K | 240 K | 350 K | 350 K | - | - | - | - | - | - | - |
21-
| eastus2 | - | - | 80 K | - | 150 K | 450 K | 300 K | - | 350 K | 350 K | 350 K | - | - | - | - | 250 K | 250 K | 250 K |
22-
| francecentral | 20 K | 60 K | 80 K | - | - | - | 240 K | - | 240 K | - | 350 K | - | - | - | - | - | - | - |
23-
| japaneast | - | - | - | 30 K | - | - | 300 K | - | 350 K | - | 350 K | - | - | - | - | - | - | - |
24-
| northcentralus | - | - | 80 K | - | 150 K | 450 K | 300 K | - | 350 K | - | - | 240 K | 250 K | 240 K | 250 K | 250 K | 250 K | 250 K |
25-
| norwayeast | - | - | 150 K | - | - | - | - | - | 350 K | - | - | - | - | - | - | - | - | - |
26-
| southafricanorth | - | - | - | - | - | - | - | - | 350 K | - | - | - | - | - | - | - | - | - |
27-
| southcentralus | - | - | 80 K | - | 150 K | 450 K | 240 K | - | 240 K | - | - | - | - | - | - | - | - | - |
28-
| southindia | - | - | 150 K | - | - | - | 300 K | - | 350 K | - | 350 K | - | - | - | - | - | - | - |
29-
| swedencentral | 40 K | 80 K | 150 K | 30 K | - | - | 300 K | 240 K | 350 K | - | 350 K | 240 K | 250 K | 240 K | 250 K | 250 K | 250 K | 250 K |
30-
| switzerlandnorth | 40 K | 80 K | - | 30 K | - | - | 300 K | - | 350 K | - | - | - | - | - | - | - | - | - |
31-
| switzerlandwest | - | - | - | - | - | - | - | - | - | - | - | - | 250 K | - | 250 K | 250 K | 250 K | 250 K |
32-
| uksouth | - | - | 80 K | - | - | - | 240 K | - | 350 K | - | 350 K | - | - | - | - | - | - | - |
33-
| westeurope | - | - | - | - | - | - | 240 K | - | 240 K | - | - | - | - | - | - | - | - | - |
34-
| westus | - | - | 80 K | 30 K | 150 K | 450 K | 300 K | - | 350 K | - | - | - | - | - | - | - | - | - |
35-
| westus3 | - | - | 80 K | - | 150 K | 450 K | - | - | 350 K | - | 350 K | - | - | - | - | - | - | - |
15+
| Region | GPT-4 | GPT-4-32K | GPT-4-Turbo | GPT-4-Turbo-V | gpt-4o | gpt-4o - GlobalStandard | GPT-35-Turbo | GPT-35-Turbo-Instruct | Text-Embedding-Ada-002 | text-embedding-3-small | text-embedding-3-large | Babbage-002 | Babbage-002 - finetune | Davinci-002 | Davinci-002 - finetune | GPT-35-Turbo - finetune | GPT-35-Turbo-1106 - finetune | GPT-35-Turbo-0125 - finetune | GPT-4 - finetune |
16+
|:-----------------|:-------:|:-----------:|:-------------:|:---------------:|:--------:|:-------------------------:|:--------------:|:-----------------------:|:------------------------:|:------------------------:|:------------------------:|:-------------:|:------------------------:|:-------------:|:------------------------:|:-------------------------:|:------------------------------:|:------------------------------:|:-------------------|
17+
| australiaeast | 40 K | 80 K | 80 K | 30 K | - | - | 300 K | - | 350 K | - | - | - | - | - | - | - | - | - | - |
18+
| brazilsouth | - | - | - | - | - | - | - | - | 350 K | - | - | - | - | - | - | - | - | - | - |
19+
| canadaeast | 40 K | 80 K | 80 K | - | - | - | 300 K | - | 350 K | 350 K | 350 K | - | - | - | - | - | - | - | - |
20+
| eastus | - | - | 80 K | - | 150 K | 450 K | 240 K | 240 K | 240 K | 350 K | 350 K | - | - | - | - | - | - | - | - |
21+
| eastus2 | - | - | 80 K | - | 150 K | 450 K | 300 K | - | 350 K | 350 K | 350 K | - | - | - | - | 250 K | 250 K | 250 K | - |
22+
| francecentral | 20 K | 60 K | 80 K | - | - | - | 240 K | - | 240 K | - | 350 K | - | - | - | - | - | - | - | - |
23+
| japaneast | - | - | - | 30 K | - | - | 300 K | - | 350 K | - | 350 K | - | - | - | - | - | - | - | - |
24+
| northcentralus | - | - | 80 K | - | 150 K | 450 K | 300 K | - | 350 K | - | - | 240 K | 250 K | 240 K | 250 K | 250 K | 250 K | 250 K | 100 K |
25+
| norwayeast | - | - | 150 K | - | - | - | - | - | 350 K | - | - | - | - | - | - | - | - | - | - |
26+
| southafricanorth | - | - | - | - | - | - | - | - | 350 K | - | - | - | - | - | - | - | - | - | - |
27+
| southcentralus | - | - | 80 K | - | 150 K | 450 K | 240 K | - | 240 K | - | - | - | - | - | - | - | - | - | - |
28+
| southindia | - | - | 150 K | - | - | - | 300 K | - | 350 K | - | 350 K | - | - | - | - | - | - | - | - |
29+
| swedencentral | 40 K | 80 K | 150 K | 30 K | - | - | 300 K | 240 K | 350 K | - | 350 K | 240 K | 250 K | 240 K | 250 K | 250 K | 250 K | 250 K | 100 K |
30+
| switzerlandnorth | 40 K | 80 K | - | 30 K | - | - | 300 K | - | 350 K | - | - | - | - | - | - | - | - | - | - |
31+
| switzerlandwest | - | - | - | - | - | - | - | - | - | - | - | - | 250 K | - | 250 K | 250 K | 250 K | 250 K | - |
32+
| uksouth | - | - | 80 K | - | - | - | 240 K | - | 350 K | - | 350 K | - | - | - | - | - | - | - | - |
33+
| westeurope | - | - | - | - | - | - | 240 K | - | 240 K | - | - | - | - | - | - | - | - | - | - |
34+
| westus | - | - | 80 K | 30 K | 150 K | 450 K | 300 K | - | 350 K | - | - | - | - | - | - | - | - | - | - |
35+
| westus3 | - | - | 80 K | - | 150 K | 450 K | - | - | 350 K | - | 350 K | - | - | - | - | - | - | - | - |
3636

3737
1 K = 1000 Tokens-Per-Minute (TPM). The relationship between TPM and Requests Per Minute (RPM) is [currently defined as 6 RPM per 1000 TPM](../../how-to/quota.md#understanding-rate-limits).
3838

0 commit comments

Comments
 (0)