Skip to content

Conversation

@noahzibm
Copy link

Added a new class to openai.py called AzureOpenAIBackend. Azure requires using the AzureOpenAI client class and an extra param api_version to work properly. Also added some logic to intelligently drop reasoning_effort if its not set as this breaks the Azure client.

@mergify
Copy link

mergify bot commented Sep 16, 2025

Merge Protections

Your pull request matches the following merge protections and will not be merged until they are valid.

🟢 Enforce conventional commit

Wonderful, this rule succeeded.

Make sure that we follow https://www.conventionalcommits.org/en/v1.0.0/

  • title ~= ^(fix|feat|docs|style|refactor|perf|test|build|ci|chore|revert)(?:\(.+\))?:

@noahzibm noahzibm changed the title Add Azure support feat: Add Azure support Sep 16, 2025
@jakelorocco
Copy link
Contributor

Thanks again for the PR @noahzibm; I've taken a look. I want to try a few things before merging this:

  • testing if litellm will work
  • seeing if there's a way to remove some of the code duplication / keep a consistent OpenAI backend

It also looks like some of the changes you made broke the OpenAIBackend by removing some of the functions. For future reference, you can install the pre-commit hooks using the command from this section to catch errors earlier.

If we end up going this route of creating the AzureOpenAIBackend, do you mind if I build off your commits and make a few changes?

@noahzibm
Copy link
Author

@jakelorocco Sure, no problem. Litellm was our backend previously, I just wasn't sure how to use it with mellea.

@nrfulton
Copy link
Contributor

I think this is resolved by @HendrikStrobelt's addition of litellm support.

@noahzibm are you satisifed with using litellm for Azure support, or should we continue work on this PR?

@noahzibm
Copy link
Author

@nrfulton I'm good with closing this one, thank you!

@nrfulton
Copy link
Contributor

Closing in favor of litellm.

@nrfulton nrfulton closed this Sep 18, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants