-
Notifications
You must be signed in to change notification settings - Fork 2.6k
feat: add new Chutes provider models #6699
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
- Added Qwen/Qwen3-Coder-480B-A35B-Instruct-FP8 model - Added moonshotai/Kimi-K2-Instruct model - Added corresponding tests for both new models Fixes #6698
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I reviewed my own code and found it only 40% complete. Classic me.
| | "tngtech/DeepSeek-R1T-Chimera" | ||
| | "zai-org/GLM-4.5-Air" | ||
| | "zai-org/GLM-4.5-FP8" | ||
| | "moonshotai/Kimi-K2-Instruct" |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I notice that the issue #6698 requested 5 models, but I only added 2. Looking at the existing code, I see that and are already present (lines 29-30). The issue had duplicates for . Could we update the PR description to clarify that 3 of the 5 requested models were already implemented?
|
Not really sure about the pricing or context window since chutes doesn't seem to provide that in the website nor the JSON available in the API |
|
@daniel-lxs @hannesrudolph can we expedite this? Qwen3 coder is a "mainstream" model for everyone these days. There's even a solution to dynamically fetch the models from chutes in here: #6698 (comment) |
|
@jordanmiguel I think we can initially add the new models, we just need to get the info of the pricing (which seems to be already available according to the comment you shared but also it would be great to the the context window, do you know where we can find that in the website or API? |
|
@daniel-lxs yes, if you access the model inside chutes website you can see it on the top right: 0,19999 USD Input And it's free with a Chutes subscription (up until you reach the requests limit)
|
|
@daniel-lxs Kimi K2: |
|
@daniel-lxs About the context window, they don't have that information on the website, but I think it's safe to assume initially that it's the same on openrouter: |
|
@daniel-lxs lastly, there's one mistake on this PR. |
|
@roomote-agent Adjust the pricing and context window of the models added based on the comments, do not create a new PR |
|
Hi @daniel-lxs! I'm on it. I'll adjust the pricing and context windows for both models based on the information provided in the comments:
Working on these changes now. |
- Update Qwen3 Coder context window from 131k to 262k - Update Kimi K2 model ID to include -75k suffix (moonshotai/Kimi-K2-Instruct-75k) - Update Kimi K2 context window from 131k to 75k - Update Kimi K2 pricing: input $0.1481, output $0.5926 - Update tests to reflect new model configurations
|
✅ @daniel-lxs All requested changes have been completed and pushed to the PR branch! Changes Made:
Testing:
The models are now configured with the correct specifications based on the information provided in the comments above. |
daniel-lxs
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM





This PR adds two new models to the Chutes provider as requested in issue #6698:
Qwen/Qwen3-Coder-480B-A35B-Instruct-FP8- A Qwen3 Coder model optimized for coding tasksmoonshotai/Kimi-K2-Instruct- Moonshot AI Kimi K2 Instruct modelChanges Made:
ChutesModelIdtype inpackages/types/src/providers/chutes.tschutesModelsobjectsrc/api/providers/__tests__/chutes.spec.tsTesting:
Fixes #6698
Important
Add new models
Qwen/Qwen3-Coder-480B-A35B-Instruct-FP8andmoonshotai/Kimi-K2-Instruct-75kto Chutes provider with configurations and tests.Qwen/Qwen3-Coder-480B-A35B-Instruct-FP8andmoonshotai/Kimi-K2-Instruct-75ktoChutesModelIdinchutes.ts.chutesModelswith configurations for new models, including context windows and descriptions.chutes.spec.tsto verify correct configurations and behavior.This description was created by
for ec5d8ac. You can customize this summary. It will automatically update as commits are pushed.