Skip to content

Commit eda2e62

Browse files
authored
docs: Overview description of model thinking (#1301)
1 parent f74c3f1 commit eda2e62

File tree

1 file changed

+32
-8
lines changed

1 file changed

+32
-8
lines changed

docs/src/modules/sdk/pages/model-provider-details.adoc

Lines changed: 32 additions & 8 deletions
Original file line numberDiff line numberDiff line change
@@ -31,6 +31,14 @@ values (like 50) allow for more diversity.
3131
=== max-tokens or max-completion-tokens
3232
If this value is supplied and the model supports this property, then it will stop operations in mid flight if the token quota runs out. It's important to check _how_ the model counts tokens, as some may count differently. Be aware of the fact that this parameter name frequently varies from one provider to the next. Make sure you're using the right property name.
3333

34+
=== Thinking
35+
Some models support thinking, also sometimes referred to as "thought process" or reasoning, where the model generates an intermediate
36+
thought process, breaking down bigger problems into smaller more manageable tasks. This can be good for more complex problems but comes
37+
at the price of tokens used for the thought process.
38+
39+
For models that support thinking, it is enabled through model-specific configuration, either by setting a thinking token budget, or
40+
by a toggle. Thinking is disabled for all models by default.
41+
3442
== Model configuration
3543
The following is a list of all natively supported model configurations. Remember that if you don't see your model or model format here, you can always create your own custom configuration and still use all of the Agent-related components.
3644

@@ -84,6 +92,10 @@ The following is a list of all natively supported model configurations. Remember
8492
| Integer
8593
| Retry this many times if the request to the model fails
8694

95+
| thinking-budget-tokens
96+
| Integer
97+
| A maximum number of tokens to spend on thinking, use 0 to disable thinking
98+
8799
|===
88100

89101

@@ -108,14 +120,6 @@ See link:{attachmentsdir}/api/akka/javasdk/agent/ModelProvider.Anthropic.html[`M
108120
| String
109121
| The Bedrock model id, e.g. "ai21.jamba-1-5-large-v1:0"
110122

111-
| send-thinking
112-
| boolean
113-
| Send thinking can be enabled
114-
115-
| return-thinking
116-
| boolean
117-
| Return thinking can be enabled
118-
119123
| max-output-tokens
120124
| Integer
121125
| Max token _output_ quota. Leave as –1 for model default
@@ -202,6 +206,14 @@ See link:{attachmentsdir}/api/akka/javasdk/agent/ModelProvider.Bedrock.html[`Mod
202206
| Integer
203207
| Retry this many times if the request to the model fails
204208

209+
| thinking-budget
210+
| Integer
211+
| A budget of tokens to spend on thinking for Gemini 2.5 models, set to "none" for other models. Can be –1 for dynamic budget, 0 for disabled, a positive value to define an upper limit for tokens spent on thinking. See https://ai.google.dev/gemini-api/docs/thinking#set-budget for details
212+
213+
| thinking-level
214+
| String
215+
| Control thinking for Gemini 3 models, exact values depend on the specific model chosen, must be empty for 2.5 models. See Google Gemini docs for more details: https://ai.google.dev/gemini-api/docs/thinking#thinking-levels
216+
205217
|===
206218

207219
See link:{attachmentsdir}/api/akka/javasdk/agent/ModelProvider.GoogleAIGemini.html[`ModelProvider.GoogleAIGemini`] for programmatic settings.
@@ -252,6 +264,10 @@ See link:{attachmentsdir}/api/akka/javasdk/agent/ModelProvider.GoogleAIGemini.ht
252264
| Integer
253265
| Retry this many times if the request to the model fails
254266

267+
| thinking
268+
| Boolean
269+
| Enable thinking, only supported for some models. Make sure the chosen model supports thinking before enabling.
270+
255271
|===
256272

257273
See link:{attachmentsdir}/api/akka/javasdk/agent/ModelProvider.HuggingFace.html[`ModelProvider.HuggingFace`] for programmatic settings.
@@ -328,6 +344,10 @@ See link:{attachmentsdir}/api/akka/javasdk/agent/ModelProvider.LocalAI.html[`Mod
328344
| Integer
329345
| Retry this many times if the request to the model fails
330346

347+
| think
348+
| Boolean
349+
| Enable thinking, only supported for some models. Make sure the chosen model supports thinking before enabling.
350+
331351
|===
332352

333353
See link:{attachmentsdir}/api/akka/javasdk/agent/ModelProvider.Ollama.html[`ModelProvider.Ollama`] for programmatic settings.
@@ -382,6 +402,10 @@ See link:{attachmentsdir}/api/akka/javasdk/agent/ModelProvider.Ollama.html[`Mode
382402
| Integer
383403
| Retry this many times if the request to the model fails
384404

405+
| thinking
406+
| Boolean
407+
| Enable thinking, only supported for DeepSeek. Make sure the chosen model supports thinking before enabling.
408+
385409
|===
386410

387411
See link:{attachmentsdir}/api/akka/javasdk/agent/ModelProvider.OpenAi.html[`ModelProvider.OpenAi`] for programmatic settings.

0 commit comments

Comments
 (0)