MCP vs Custom Model Provider Server?

[projektjoe]

I have many repositories that I want to perform RAG on.
I want to be able to create complex agentic workflows. Is it possible to use Model Provider to input my own endpoint that is on Azure? In this case can I stream the output of the progress of that endpoint? or would it be better to use MCP? Is there a better alternative to these two?

[Patrick-Erichsen]

Your question is can you use the a custom model provider to query an MCP server? If so, the answer is no, custom model providers are for querying LLMs

[projektjoe]

No, I am asking if I can put an Azure App Service endpoint as a custom model provider. (so that I can have my own complex logic e.g. LangGraph workflow)

[Patrick-Erichsen]

Ah, I'm not familiar with Azure App Service unfortunately. At the least I don't know of anyone using it as a custom model provider. I'm confused by your question though because model providers and MCP are two completely separate concepts. I think you're looking for an MCP if you're doing LangGraph things.

[projektjoe]

Hi Patrick. I was able indeed to place an Azure App Service endpoint as an LLM provider and stream the response (and therefore using my custom RAG pipeline). Thanks for the answer!