feat: Add reasoningEffort parameter to OpenAI API and Chat Options #2163
Conversation
apappascs
force-pushed
the
feat/openai-reasoning-effort
branch
from
2265516 to
ccb37fe
Compare
This commit introduces the `reasoningEffort` parameter to the OpenAI API integration, allowing control over the reasoning effort used by models like `o1-mini`. Changes: - Adds `reasoningEffort` field to `OpenAiApi.ChatCompletionRequest`. - Adds `reasoningEffort` field and builder method to `OpenAiChatOptions`. Signed-off-by: Alexandros Pappas <[email protected]> Signed-off-by: Alexandros Pappas <[email protected]>
apappascs
force-pushed
the
feat/openai-reasoning-effort
branch
from
ccb37fe to
93535f9
Compare
| * @param streamOptions The new stream options to use. | ||
| * @return A new {@link ChatCompletionRequest} with the specified stream options. | ||
| */ | ||
| public ChatCompletionRequest streamOptions(StreamOptions streamOptions) { |
There was a problem hiding this comment.
We should add any new option as the last argument of the constructor to avoid breaking the existing constructor as this is a public constructor
There was a problem hiding this comment.
Thank you @ilayaperumalg . just moved it as the last one for all public constructors.
There was a problem hiding this comment.
Thank you @apappascs for the quick turn around. Will get this reviewed shortly
There was a problem hiding this comment.
FYI:
The parameter for reasoning effort is available only for use with the ‘full’ o1 model which is currently being rolled-out to Tier 5 users. So it really depends on the api-key tier Spring team has on the tests so that it can pass
source: https://community.openai.com/t/o1s-reasoning-effort-parameter/1062308
There was a problem hiding this comment.
Thanks for the info. For now, I will disable the test as this is for a specific model. But, let's keep the test.
Signed-off-by: Alexandros Pappas <[email protected]>
|
Squashed, rebased, disabled the test (as discussed in the thread above) and merged as 35101e7 |
3 participants
This commit introduces the
reasoningEffortparameter to the OpenAI API integration, allowing control over the reasoning effort used by models likeo1-mini.Changes:
reasoningEffortfield toOpenAiApi.ChatCompletionRequest.reasoningEffortfield and builder method toOpenAiChatOptions.resolves #2153