Skip to content

Commit 2763639

Browse files
committed
update
1 parent b8be2a4 commit 2763639

File tree

6 files changed

+6
-9
lines changed

6 files changed

+6
-9
lines changed

articles/ai-services/openai/concepts/models.md

Lines changed: 0 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -212,7 +212,6 @@ The following models support global batch:
212212
| Model | Version | Input format |
213213
|---|---|
214214
|`gpt-4o` | 2024-05-13 |text + image |
215-
|`gpt-4o-mini` | 2024-07-18 |text + image |
216215
|`gpt-4` | turbo-2024-04-09 | text |
217216
|`gpt-4` | 0613 | text |
218217
| `gpt-35-turbo` | 0125 | text |

articles/ai-services/openai/how-to/batch.md

Lines changed: 3 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -6,7 +6,7 @@ manager: nitinme
66
ms.service: azure-ai-openai
77
ms.custom:
88
ms.topic: how-to
9-
ms.date: 08/01/2024
9+
ms.date: 08/04/2024
1010
author: mrbullwinkle
1111
ms.author: mbullwin
1212
recommendations: false
@@ -53,7 +53,6 @@ The following models support global batch:
5353
| Model | Version | Supported |
5454
|---|---|
5555
|`gpt-4o` | 2024-05-13 |Yes (text + vision) |
56-
|`gpt-4o-mini` | 2024-07-18 |Yes (text + vision) |
5756
|`gpt-4` | turbo-2024-04-09 | Yes (text only) |
5857
|`gpt-4` | 0613 | Yes |
5958
| `gpt-35-turbo` | 0125 | Yes |
@@ -81,7 +80,7 @@ In the Studio UI the deployment type will appear as `Global-Batch`.
8180
:::image type="content" source="../media/how-to/global-batch/global-batch.png" alt-text="Screenshot that shows the model deployment dialog in Azure OpenAI Studio with Global-Batch deployment type highlighted." lightbox="../media/how-to/global-batch/global-batch.png":::
8281

8382
> [!TIP]
84-
> Each line of your input file for batch processing requires the unique **deployment name** that you chose during model deployment to be present. This value wil be assigned to the `model` parameter. This is different from OpenAI where the concept of model deployments does not exist.
83+
> Each line of your input file for batch processing requires the unique **deployment name** that you chose during model deployment to be present. This value wil be assigned to the `model` attribute. This is different from OpenAI where the concept of model deployments does not exist.
8584
8685
::: zone pivot="programming-language-ai-studio"
8786

@@ -132,7 +131,7 @@ In the Studio UI the deployment type will appear as `Global-Batch`.
132131

133132
### Can images be used with the batch API?
134133

135-
This capability is limited to certain multi-modal models. Currently only GPT-4o and GPT-4o mini support images as part of batch requests. Images can be provided as input either via [image url or a base64 encoded representation of the image](#input-format). Images for batch are currently not supported with GPT-4 Turbo.
134+
This capability is limited to certain multi-modal models. Currently only GPT-4o support images as part of batch requests. Images can be provided as input either via [image url or a base64 encoded representation of the image](#input-format). Images for batch are currently not supported with GPT-4 Turbo.
136135

137136
### Can I use the batch API with fine-tuned models?
138137

articles/ai-services/openai/includes/batch/batch-python.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -59,7 +59,7 @@ Like [fine-tuning](../../how-to/fine-tuning.md), global batch uses files in JSON
5959

6060
The `custom_id` is required to allow you to identify which individual batch request corresponds to a given response. Responses won't be returned in identical order to the order defined in the `.jsonl` batch file.
6161

62-
`model` should be set to match the **model deployment name** of the global batch model you wish to target for inference responses.
62+
`model` attribute should be set to match the name of the Global Batch deployment you wish to target for inference responses.
6363

6464
### Create input file
6565

articles/ai-services/openai/includes/batch/batch-rest.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -48,7 +48,7 @@ Like [fine-tuning](../../how-to/fine-tuning.md), global batch uses files in JSON
4848

4949
The `custom_id` is required to allow you to identify which individual batch request corresponds to a given response. Responses won't be returned in identical order to the order defined in the `.jsonl` batch file.
5050

51-
`model` should be set to match the **model deployment name** of the global batch model you wish to target for inference responses.
51+
`model` attribute should be set to match the name of the Global Batch deployment you wish to target for inference responses.
5252

5353
### Create input file
5454

articles/ai-services/openai/includes/batch/batch-studio.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -48,7 +48,7 @@ Like [fine-tuning](../../how-to/fine-tuning.md), global batch uses files in JSON
4848

4949
The `custom_id` is required to allow you to identify which individual batch request corresponds to a given response. Responses won't be returned in identical order to the order defined in the `.jsonl` batch file.
5050

51-
`model` should be set to match the **model deployment name** of the global batch model you wish to target for inference responses.
51+
`model` attribute should be set to match the name of the Global Batch deployment you wish to target for inference responses.
5252

5353
### Create input file
5454

articles/ai-services/openai/includes/global-batch-limits.md

Lines changed: 0 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -23,7 +23,6 @@ The table shows the batch quota limit. Quota values for global batch are represe
2323
|Model|Enterprise agreement|Default| Monthly credit card based subscriptions | MSDN subscriptions | Azure for Students, Free Trials |
2424
|---|---|---|---|---|---|
2525
| `gpt-4o` | 5 B | 50 M | 1.35 M | 90 K | N/A|
26-
| `gpt-4o-mini` | 1 B | 40 M | 20 M | 2 M | N/A|
2726
| `gpt-4-turbo`<sup>*</sup> | 300 M | 40 M | 1.35 M | 90 K | N/A |
2827
| `gpt-4` | 150 M | 5 M | 200 K | 100 K | N/A |
2928
| `gpt-35-turbo` | 10 B | 100 M | 5 M | 2 M | 50 K |

0 commit comments

Comments
 (0)