Merge pull request #812 from mrbullwinkle/mrb_10_14_2024_batch_structured_outputs

[Azure OpenAI] Global Batch + Structured Outputs known issue.

Author: prmerger-automator[bot]

articles/ai-services/openai/how-to/batch.md

@@ -6,7 +6,7 @@ manager: nitinme
 ms.service: azure-ai-openai
 ms.custom: 
 ms.topic: how-to
-ms.date: 10/11/2024
+ms.date: 10/14/2024
 author: mrbullwinkle
 ms.author: mbullwin
 recommendations: false
@@ -76,6 +76,13 @@ The following aren't currently supported:
 - Integration with the Assistants API.
 - Integration with Azure OpenAI On Your Data feature.
 
+> [!NOTE]
+> There is a known issue with Azure OpenAI global batch and [structured outputs](./structured-outputs.md). Currently, lines in your jsonl file with structured output requests will fail with the following error message written to the error file:
+>
+> ***response_format value as json_schema is enabled only for api versions 2024-08-01-preview and later***.
+>
+>This error will occur even when your code targets the latest preview APIs which support structured outputs. Once the issue is resolved, this page will be updated.
+
 ### Global batch deployment
 
 In the Studio UI the deployment type will appear as `Global-Batch`.

articles/ai-services/openai/how-to/structured-outputs.md

@@ -16,16 +16,18 @@ recommendations: false
 
 Structured outputs make a model follow a [JSON Schema](https://json-schema.org/overview/what-is-jsonschema) definition that you provide as part of your inference API call. This is in contrast to the older [JSON mode](./json-mode.md) feature, which guaranteed valid JSON would be generated, but was unable to ensure strict adherence to the supplied schema. Structured outputs is recommended for function calling, extracting structured data, and building complex multi-step workflows.
 
->[!NOTE]
-> Currently Structured outputs is not supported on [bring your own data](../concepts/use-your-data.md) scenario.
+> [!NOTE]
+> * Currently structured outputs is not supported on [bring your own data](../concepts/use-your-data.md) scenario.
+>
+> * There is a known issue blocking structured outputs support for [global batch](batch.md).
 
 ## Supported models
 
 Currently only `gpt-4o` version: `2024-08-06` supports structured outputs.
 
 ## API support
 
-Support for structured outputs was first added in API version `2024-08-01-preview`. 
+Support for structured outputs was first added in API version `2024-08-01-preview`.
 
 ## Getting started