Skip to content

Commit 7f72100

Browse files
Merge pull request #79 from mrbullwinkle/mrb_08_30_2024_batch
[Azure OpenAI] Batch Update
2 parents dcc6436 + a7b228d commit 7f72100

File tree

4 files changed

+11
-2
lines changed

4 files changed

+11
-2
lines changed

articles/ai-services/openai/how-to/batch.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -6,7 +6,7 @@ manager: nitinme
66
ms.service: azure-ai-openai
77
ms.custom:
88
ms.topic: how-to
9-
ms.date: 08/12/2024
9+
ms.date: 08/30/2024
1010
author: mrbullwinkle
1111
ms.author: mbullwin
1212
recommendations: false

articles/ai-services/openai/includes/batch/batch-python.md

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -61,6 +61,9 @@ The `custom_id` is required to allow you to identify which individual batch requ
6161

6262
`model` attribute should be set to match the name of the Global Batch deployment you wish to target for inference responses.
6363

64+
> [!IMPORTANT]
65+
> The `model` attribute must be set to match the name of the Global Batch deployment you wish to target for inference responses. The **same Global Batch model deployment name must be present on each line of the batch file.** If you want to target a different deployment you must do so in a separate batch file/job.
66+
6467
### Create input file
6568

6669
For this article we'll create a file named `test.jsonl` and will copy the contents from standard input code block above to the file. You will need to modify and add your global batch deployment name to each line of the file. Save this file in the same directory that you're executing your Jupyter Notebook.

articles/ai-services/openai/includes/batch/batch-rest.md

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -50,6 +50,9 @@ The `custom_id` is required to allow you to identify which individual batch requ
5050

5151
`model` attribute should be set to match the name of the Global Batch deployment you wish to target for inference responses.
5252

53+
> [!IMPORTANT]
54+
> The `model` attribute must be set to match the name of the Global Batch deployment you wish to target for inference responses. The **same Global Batch model deployment name must be present on each line of the batch file.** If you want to target a different deployment you must do so in a separate batch file/job.
55+
5356
### Create input file
5457

5558
For this article we'll create a file named `test.jsonl` and will copy the contents from standard input code block above to the file. You will need to modify and add your global batch deployment name to each line of the file.

articles/ai-services/openai/includes/batch/batch-studio.md

Lines changed: 4 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -48,7 +48,10 @@ Like [fine-tuning](../../how-to/fine-tuning.md), global batch uses files in JSON
4848

4949
The `custom_id` is required to allow you to identify which individual batch request corresponds to a given response. Responses won't be returned in identical order to the order defined in the `.jsonl` batch file.
5050

51-
`model` attribute should be set to match the name of the Global Batch deployment you wish to target for inference responses.
51+
`model` attribute should be set to match the name of the Global Batch deployment you wish to target for inference responses.
52+
53+
> [!IMPORTANT]
54+
> The `model` attribute must be set to match the name of the Global Batch deployment you wish to target for inference responses. The **same Global Batch model deployment name must be present on each line of the batch file.** If you want to target a different deployment you must do so in a separate batch file/job.
5255
5356
### Create input file
5457

0 commit comments

Comments
 (0)