Request for New Feature: OpenAI Chat Model API Support via AzureMLChatOnlineEndpoint

[Swty13]

Checked

• I searched existing ideas and did not find a similar one
• I added a very descriptive title
• I've clearly described the feature request and motivation for it

Feature request

Feature Request:
Add support for calling OpenAI chat models through the AzureMLChatOnlineEndpoint.

Current Implementation:
Currently, the AzureMLChatOnlineEndpoint supports calling the endpoint with the following configuration:
chat = AzureMLChatOnlineEndpoint( endpoint_url="https://<your-endpoint>.<your_region>.inference.ml.azure.com/score", endpoint_api_type=AzureMLEndpointApiType.dedicated, endpoint_api_key="my-api-key", content_formatter=CustomOpenAIChatContentFormatter(), )
However, it does not support the OpenAI chat model API.
(Currently OpenAI chat models supported by AzureChatOpenAI)

Proposed Enhancement:
Enable the AzureMLChatOnlineEndpoint to support OpenAI chat models when the endpoint URL follows this format: https://example-resource.azure.openai.com/.

Please add this feature to allow seamless integration with OpenAI chat models through the specified endpoint URL format.

Motivation

To create a unified framework that allows the use of all models through a single endpoint, simplifying the infrastructure and enhancing efficiency.

Current Challenge:
Currently, the AzureMLChatOnlineEndpoint does not support OpenAI chat models. This limitation necessitates multiple endpoint calls when integrating various models, complicating the infrastructure and increasing overhead.

By implementing this feature, we can achieve a more robust, efficient, and scalable framework that supports diverse model integrations seamlessly.

Proposal (If applicable)

Integrate support for OpenAI chat models into the AzureMLChatOnlineEndpoint, specifically for endpoint URLs formatted as https://example-resource.azure.openai.com/