You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: docs/src/modules/sdk/pages/model-provider-details.adoc
+32-8Lines changed: 32 additions & 8 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -31,6 +31,14 @@ values (like 50) allow for more diversity.
31
31
=== max-tokens or max-completion-tokens
32
32
If this value is supplied and the model supports this property, then it will stop operations in mid flight if the token quota runs out. It's important to check _how_ the model counts tokens, as some may count differently. Be aware of the fact that this parameter name frequently varies from one provider to the next. Make sure you're using the right property name.
33
33
34
+
=== Thinking
35
+
Some models support thinking, also sometimes referred to as "thought process" or reasoning, where the model generates an intermediate
36
+
thought process, breaking down bigger problems into smaller more manageable tasks. This can be good for more complex problems but comes
37
+
at the price of tokens used for the thought process.
38
+
39
+
For models that support thinking, it is enabled through model-specific configuration, either by setting a thinking token budget, or
40
+
by a toggle. Thinking is disabled for all models by default.
41
+
34
42
== Model configuration
35
43
The following is a list of all natively supported model configurations. Remember that if you don't see your model or model format here, you can always create your own custom configuration and still use all of the Agent-related components.
36
44
@@ -84,6 +92,10 @@ The following is a list of all natively supported model configurations. Remember
84
92
| Integer
85
93
| Retry this many times if the request to the model fails
86
94
95
+
| thinking-budget-tokens
96
+
| Integer
97
+
| A maximum number of tokens to spend on thinking, use 0 to disable thinking
98
+
87
99
|===
88
100
89
101
@@ -108,14 +120,6 @@ See link:{attachmentsdir}/api/akka/javasdk/agent/ModelProvider.Anthropic.html[`M
108
120
| String
109
121
| The Bedrock model id, e.g. "ai21.jamba-1-5-large-v1:0"
110
122
111
-
| send-thinking
112
-
| boolean
113
-
| Send thinking can be enabled
114
-
115
-
| return-thinking
116
-
| boolean
117
-
| Return thinking can be enabled
118
-
119
123
| max-output-tokens
120
124
| Integer
121
125
| Max token _output_ quota. Leave as –1 for model default
@@ -202,6 +206,14 @@ See link:{attachmentsdir}/api/akka/javasdk/agent/ModelProvider.Bedrock.html[`Mod
202
206
| Integer
203
207
| Retry this many times if the request to the model fails
204
208
209
+
| thinking-budget
210
+
| Integer
211
+
| A budget of tokens to spend on thinking for Gemini 2.5 models, set to "none" for other models. Can be –1 for dynamic budget, 0 for disabled, a positive value to define an upper limit for tokens spent on thinking. See https://ai.google.dev/gemini-api/docs/thinking#set-budget for details
212
+
213
+
| thinking-level
214
+
| String
215
+
| Control thinking for Gemini 3 models, exact values depend on the specific model chosen, must be empty for 2.5 models. See Google Gemini docs for more details: https://ai.google.dev/gemini-api/docs/thinking#thinking-levels
216
+
205
217
|===
206
218
207
219
See link:{attachmentsdir}/api/akka/javasdk/agent/ModelProvider.GoogleAIGemini.html[`ModelProvider.GoogleAIGemini`] for programmatic settings.
@@ -252,6 +264,10 @@ See link:{attachmentsdir}/api/akka/javasdk/agent/ModelProvider.GoogleAIGemini.ht
252
264
| Integer
253
265
| Retry this many times if the request to the model fails
254
266
267
+
| thinking
268
+
| Boolean
269
+
| Enable thinking, only supported for some models. Make sure the chosen model supports thinking before enabling.
270
+
255
271
|===
256
272
257
273
See link:{attachmentsdir}/api/akka/javasdk/agent/ModelProvider.HuggingFace.html[`ModelProvider.HuggingFace`] for programmatic settings.
@@ -328,6 +344,10 @@ See link:{attachmentsdir}/api/akka/javasdk/agent/ModelProvider.LocalAI.html[`Mod
328
344
| Integer
329
345
| Retry this many times if the request to the model fails
330
346
347
+
| think
348
+
| Boolean
349
+
| Enable thinking, only supported for some models. Make sure the chosen model supports thinking before enabling.
350
+
331
351
|===
332
352
333
353
See link:{attachmentsdir}/api/akka/javasdk/agent/ModelProvider.Ollama.html[`ModelProvider.Ollama`] for programmatic settings.
@@ -382,6 +402,10 @@ See link:{attachmentsdir}/api/akka/javasdk/agent/ModelProvider.Ollama.html[`Mode
382
402
| Integer
383
403
| Retry this many times if the request to the model fails
384
404
405
+
| thinking
406
+
| Boolean
407
+
| Enable thinking, only supported for DeepSeek. Make sure the chosen model supports thinking before enabling.
408
+
385
409
|===
386
410
387
411
See link:{attachmentsdir}/api/akka/javasdk/agent/ModelProvider.OpenAi.html[`ModelProvider.OpenAi`] for programmatic settings.
0 commit comments