Add MLflow AI Gateway as a supported backend #3224
ZeroCool2u
started this conversation in
Feature Requests
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
MLflow AI Gateway is used by a number of large enterprise organizations as a proxy for their various LLM providers. Supporting it as a backend would allow Roo to be used internally while they centrally manage their LLM API providers and critically their API keys.
The Gateway servers API is extremely well documented here.
Beta Was this translation helpful? Give feedback.
All reactions