Replies: 2 comments
-
|
https://github.com/guojinpeng/cli_proxy 这个项目有模型路由的功能,大佬可以作为参考 |
Beta Was this translation helpful? Give feedback.
0 replies
-
|
@luispater It's been good to see some activity on the original issue and it being converted into a discussion. Is there any current plans or interest on the part of the lead contributors to include such a feature? |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
-
Are there currently any plans for intelligent model routing capabilities in CLIProxyAPI on the part of the active maintainers, once the pressing issues are addressed?
Given that it mostly deals with free CLI providers that all have token rate limits which may have different strengths, it would be very fitting to include a model that adapts to the query sent based on its context and tokens left on each service/model.
It would also benefit from, and be of benefit to, #112
Beta Was this translation helpful? Give feedback.
All reactions