Skip to content

Commit d9efd37

Browse files
committed
Learn Editor: Update provisioned-throughput.md
1 parent 8812d26 commit d9efd37

File tree

1 file changed

+5
-2
lines changed

1 file changed

+5
-2
lines changed

articles/ai-services/openai/concepts/provisioned-throughput.md

Lines changed: 5 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -43,9 +43,12 @@ The amount of throughput (tokens per minute or TPM) a deployment gets per PTU is
4343

4444
To help with simplifying the sizing effort, the following table outlines the TPM per PTU for the `gpt-4o` and `gpt-4o-mini` models which represent the max TPM assuming all traffic is either input or output. To understand how different ratios of input and output tokens impact your Max TPM per PTU, see the [Azure OpenAI capacity calculator](https://oai.azure.com/portal/calculator). The table also shows Service Level Agreement (SLA) Latency Target Values per model. For more information about the SLA for Azure OpenAI Service, see the [Service Level Agreements (SLA) for Online Services page](https://www.microsoft.com/licensing/docs/view/Service-Level-Agreements-SLA-for-Online-Services?lang=1)
4545

46-
| | **gpt-4o**, **2024-05-13** & **gpt-4o**, **2024-08-06** | **gpt-4o-mini**, **2024-07-18** |
46+
|| **gpt-4o**, **2024-05-13** & **gpt-4o**, **2024-08-06** | **gpt-4o-mini**, **2024-07-18** |
4747
| --- | --- | --- |
48-
| Deployable Increments | 50 | 25|
48+
|Global provisioned minimum deployment|15|15|
49+
|Global provisioned scale increment|5|5|
50+
| Regional provisioned minimum deployment | 50 | 25|
51+
|Regional provisioned scale increment|50|25|
4952
|Max Input TPM per PTU | 2,500 | 37,000 |
5053
|Max Output TPM per PTU| 833|12,333|
5154
| Latency Target Value |25 Tokens Per Second|33 Tokens Per Second|

0 commit comments

Comments
 (0)