MCP issue with Llama cpp docker models #8736
Replies: 7 comments 11 replies
-
|
This seems like a shortcoming with the “llama-swap” custom endpoint you are using, maybe it can’t process specific function definitions that are needed for the MCP servers you are using. Have you tried another endpoint? which specific server are you attempting to use at the time of the error? |
Beta Was this translation helpful? Give feedback.
-
|
@danny-avila Llama-swap works fine with the same mcp server with Jan and open webui. I suspect something is happening with Librechat and llama-swap; notice from the logs librechat is failing to fetch models from Llamaswap API error |
Beta Was this translation helpful? Give feedback.
-
|
@danny-avila, i ran llama cpp in docker and I still get the same error, so its not llama-swap related.
|
Beta Was this translation helpful? Give feedback.
-
|
I have this problem too with llama.cpp |
Beta Was this translation helpful? Give feedback.
-
|
@danny-avila AFAIK, there have been three LibreChat or "@modelcontextprotocol/server-filesystem" issues that have prevented the combination of llama.cpp + LibreChat + "@modelcontextprotocol/server-filesystem" from working, I've listed them below. Of these three, only issue 1 titled " My system:
Three llama.cpp + LibreChat + "@modelcontextprotocol/server-filesystem" issues:zod.ts patch: |
Beta Was this translation helpful? Give feedback.
-
|
@marcmcd Thanks for your investigation and patch! I have been trying to understand the issue better myself and was trying to nail down where the Both the patched and upstream LibreChat and the patched The Zod v4 has native JSON schema conversion, and the Long term the fix seems to be to upgrade LibreChat and Short term we can try to patch Putting this patch into LibreChat makes the filesystem MCP work also. It looks like the maintainer of |
Beta Was this translation helpful? Give feedback.
-
|
FYI I don't have the |
Beta Was this translation helpful? Give feedback.



Uh oh!
There was an error while loading. Please reload this page.
-
What happened?
I have Librechat setup with custom endpoint with llama-swap.
I have setup a couple of mcp servers but I get an error message when I try to call an mcp
error: [api/server/controllers/agents/client.js #sendCompletion] Unhandled error type 500 JSON schema conversion failed: Unrecognized schema: {"not":{}}Any thoughts?
Version Information
ce3b00be875a
Steps to Reproduce
What browsers are you seeing the problem on?
Microsoft Edge
Relevant log output
Screenshots
No response
Code of Conduct
Beta Was this translation helpful? Give feedback.
All reactions