Make Databricks models streaming in OpenAI Compatible provider

[dooezgo]

Context

update the condition to detect the Databrick Azure provider in OpenAI Compatible provider config to make it stream the response.
WHY: The stream option does not work for the Databricks model

Implementation

Based on #2449 , add condition isDatabricksAI

Screenshots

before	after

How to Test

Configure Databricks Azure API endpoint in the Open AI Compatible provider and enable streaming support.
After the fix streaming works with models are provided by Databricks can stream as expected.
I didn't try on Databrick instance on AWS.

Get in Touch

---

Important

Add support for streaming Databricks models in OpenAI Compatible provider by excluding stream_options for Databricks AI.

• Behavior:
  • Update OpenAiHandler in openai.ts to support streaming for Databricks models by excluding stream_options when isDatabricksAI is true.
  • Introduce _isDatabricksAI() method to detect Databricks AI based on openAiBaseUrl.
• Tests:
  • Add tests in openai.test.ts to verify Databricks AI configuration and ensure stream_options is excluded during streaming.
  • Test cases include initialization and streaming behavior for Databricks AI.

^{This description was created by for e05d7696193a1833d10c11898d328c7d7dbe5bd8. It will automatically update as commits are pushed.}

[changeset-bot]

⚠️ No Changeset found

Latest commit: abcf613

Merging this PR will not cause a version bump for any packages. If these changes should not result in a new version, you're good to go. If these changes should result in a version bump, you need to add a changeset.

This PR includes no changesets

When changesets are added to this PR, you'll see the packages that this PR includes changesets for and the associated semver types

Click here to learn what changesets are, and how to add one.

Click here if you're a maintainer who wants to add a changeset to this PR

[ellipsis-dev]

Consider extracting the (isGrokXAI || isDatabricksAI) check into a helper function for clarity and maintainability if similar conditions are repeated in the future.

[samhvw8]

Should we make azure profiler for this ?

[dooezgo]

Should we make azure profiler for this ?

@samhvw8 Databricks is hosted on multiple cloud platforms. They have the same API usage. So I don't think we need to create the Azure profiler for it. How do you think?

[daniel-lxs]

Thanks for your contribution. We genuinely apologize the delay on reviewing your PR.

We're closing this PR because we'd prefer have an issue for this since we now shifted to a clearer issue-first workflow to avoid this kind of situation going forward. Please open a new issue if you'd like to revisit this PR.

We truly appreciate your patience and would be happy to have you continue contributing.