-
Notifications
You must be signed in to change notification settings - Fork 11
docs: Overview description of model thinking #1301
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
ennru
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM.
Co-authored-by: Enno Runne <458526+ennru@users.noreply.github.com>
| at the price of tokens used for the thought process. | ||
|
|
||
| For models that support thinking, it is enabled through model-specific configuration, either by setting a thinking token budget, or | ||
| by a toggle. Thinking is disabled for all models by default. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
It is actually an enum for gemini 3, but this is close enough.
patriknw
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM
| by a toggle. Thinking is disabled for all models by default. | ||
|
|
||
| == Model configuration | ||
| The following is a list of all natively supported model configurations. Remember that if you don't see your model or model format here, you can always create your own custom configuration and still use all of the Agent-related components. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Shouldn't it be listed in below table too, for each model that supports it?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Ah, I didn't notice this is manual table, thought it was pulled in from reference.conf. Yes, I'll add it for each model here as well.
| | return-thinking | ||
| | boolean | ||
| | Return thinking can be enabled | ||
|
|
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
These two were accidentally added with the bedrock support, controlled by runtime (for all models)
|
Vale is complaining that a negative number is using a hyphen instead of an en dash. 🤷 |
|
Vale, all he ever does is complain. |
Follow up to #1249