Support structured output in Azure OpenAI as well

[philippn]

Hi there,

Microsoft has added support for structured output in Azure AI OpenAI SDK beta 1.0.0-beta12. It's pretty similar to the feature in the original OpenAI endpoint. Please see https://github.com/Azure/azure-sdk-for-java/blob/azure-ai-openai_1.0.0-beta.12/sdk/openai/azure-ai-openai/src/samples/java/com/azure/ai/openai/StructuredOutputsResponseFormat.java for example usage.

It would be great if this could be incorporated into Spring AI. Right now the requestFormat here is still limited to JSON and TEXT (see here).

Thanks in advance and kind regards,
Philipp

[nwflte]

+1

[dev-jonghoonpark]

recent related issue: #2725
I created PR about this feature : #2754

@markpollack

[markpollack]

Thanks, triaging all the azure issue now. There is a PR for base support in the model, #2431 but we still need to better accommodate this native model json approach when using ChatClient

[markpollack]

This has been merged.