Replies: 2 comments
-
|
用oneapi转一层有点麻烦,还需要多起用一个服务 |
Beta Was this translation helpful? Give feedback.
0 replies
-
|
每个LLM的token不一样 |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
功能建议:通过网关整合所有的模型到一个docker镜像里面,通过 参数"model": "XXX"来调用不同的LLM,支持对用户token的管理
Beta Was this translation helpful? Give feedback.
All reactions