-
Notifications
You must be signed in to change notification settings - Fork 2.4k
Add zai glm model #8897
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add zai glm model #8897
Conversation
- Add zai-glm-4.6 with 128K context window and 40K max tokens - Set zai-glm-4.6 as default Cerebras model - Update gpt-oss-120b to 128K context and 40K max tokens
- Add zai-glm-4.6 with 128K context window and 40K max tokens - Set zai-glm-4.6 as default Cerebras model - Model provides ~2000 tokens/s for general-purpose tasks
PR Review SummaryAll previously identified issues have been resolved:
No new issues were identified in the latest changes. |
| export type CerebrasModelId = keyof typeof cerebrasModels | ||
|
|
||
| export const cerebrasDefaultModelId: CerebrasModelId = "qwen-3-coder-480b-free" | ||
| export const cerebrasDefaultModelId: CerebrasModelId = "zai-glm-4.6" |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Setting this unreleased model as the default will break the Cerebras provider for all users until November 5th. According to the PR description, zai-glm-4.6 becomes available on November 5th, but this PR is being merged on October 29th. Users who select Cerebras as their provider will encounter API errors for approximately one week because the default model doesn't exist yet. Consider keeping qwen-3-coder-480b-free as the default until the new model is actually available on the platform.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thank you!
|
Created this PR #8920 to fix the failing unit test |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Looks good to me.
Added zai-glm-4.6 as a Cerebras model. It will become available on the platform November 5th.
Pre-Submission Checklist
Important
Add
zai-glm-4.6model to Cerebras and set it as default incerebras.ts.zai-glm-4.6tocerebrasModelsincerebras.tswith attributes:maxTokens: 40000,contextWindow: 128000,supportsImages: false,supportsPromptCache: false,inputPrice: 0,outputPrice: 0,description: "Highly intelligent general-purpose model with ~2000 tokens/s".cerebrasDefaultModelIdtozai-glm-4.6incerebras.ts.This description was created by
for 7e7c7fe. You can customize this summary. It will automatically update as commits are pushed.