Support for referencing Langflow Agents or MCP Server in LiteLLM?

[flefevre]

Hi LiteLLM team

I wanted to ask if LiteLLM currently supports referencing or routing requests to agents built using Langflow's agent system or their MCP server.

Specifically:

Is it possible to integrate a Langflow agent endpoint as a "model" in LiteLLM's configuration?

Similarly, can LiteLLM call a Langflow MCP server endpoint in the same way it would call OpenAI or other custom endpoints?

If not currently supported, would this kind of integration fall within the project's scope?

The goal would be to use Langflow-constructed agents as "models" that LiteLLM can route to based on model name or use them in conjunction with LiteLLM’s proxy features.

If it is already possible, could you provide some tips or better a tutorial in the documentation.

Thanks again for your time and looking forward to your thoughts on this!

Best,
François

[krrishdholakia]

is a langflow MCP server, like any other MCP server? if so it would just be like a tool to a model which supports mcp servers right (openai/anthropic for now i think). ?

[flefevre]

Yes Langflow transform any flow into a normal Mcp server.

https://docs.langflow.org/mcp-server

So litellm should be able to manage it as any Mcp server.

[krrishdholakia]

Is it possible to integrate a Langflow agent endpoint as a "model" in LiteLLM's configuration?

not sure. what's the api spec? @flefevre

[flefevre]

Badly I am not part of Langflow team but here we have some details on the publication of an agent

https://youtu.be/_KUgOAujVZ8?si=EjhrNnrbrYY_0vGX&t=5m55s

Documentation

https://docs.langflow.org/components-agents