When I use **oneapi** to relay OpenRouter, I can't show the thinking model's thinking label in custom endpoint #7087
Unanswered
harrisonhxy
asked this question in
Troubleshooting
Replies: 1 comment 1 reply
-
Seems like a oneapi issue |
Beta Was this translation helpful? Give feedback.
1 reply
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
What happened?
OpenRouter provides a lot of models, I mainly use one of the thinking models, such as deepseek, grok-3-mini-beta, etc. When I plug OpenRouter into one-api, and use custom endpoint in
librechat.yml
to customize the endpoints, the thinking model loses the thinking tag, and doesn't show the contents of the thinking, only the result of the answer.Version Information
ghcr.io/danny-avila//librechat latest 9b0706aeaa4a 20 hours ago 958MB
ghcr.io/danny-avila/librechat-rag-api-dev-lite latest 817faebddae9 2 weeks ago 1.31GB
ghcr.io/rubentalstra/librechat-prom-exporter latest 05eee494c72a 5 weeks ago 245MB
Steps to Reproduce
For example, when I forward DeepSeek from OpenRouter through oneapi, my custom endpoint is set up as follows:
DeepSeek at this point would not have a thinking process
DeepSeek got the thinking process going when I set the
name
field in the custom endpoint, with openrouter (case-insensitive). the custom endpoint settings are shown below:I know that the
name
field of the custom endpoint is case-insensitive, so I'm guessing that when I setname: "deepseek"
, it will automatically go DeepSeek's route. And when I set it toname: "openrouterdeepseek"
, it may use OpenRouter's routes. This in undoubtedly limits the advantages of custom endpoint, because there are many vendors that provide DeepSeek models, but LibreChat separates them by different vendor channels. even if I use oneapi aggregation on the backend, I can't achieve polling for multiple vendor channels under the same model nameWhat browsers are you seeing the problem on?
Chrome
Relevant log output
Librechat's container logs don't show any error messages
Screenshots
No response
Code of Conduct
Beta Was this translation helpful? Give feedback.
All reactions