Skip to content
This repository was archived by the owner on Jul 22, 2025. It is now read-only.

Conversation

@SamSaffron
Copy link
Member

@SamSaffron SamSaffron commented Feb 2, 2025

Reasoning models such as o3 mini require a much longer timeout, bump timeout from 1 to 6 minutes.

Reasoning models can be configured multiple times as llms, model_name is not unique, do not base selectors on model name, use id instead

model_name is not unique, in the case of reasoning models
you may configure the same llm multiple times using different
reasoning levels.
@SamSaffron SamSaffron changed the title timeout FEATURE: improve o3-mini support Feb 2, 2025
@SamSaffron SamSaffron merged commit cf86d27 into main Feb 2, 2025
6 checks passed
@SamSaffron SamSaffron deleted the timeout branch February 2, 2025 21:45
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Development

Successfully merging this pull request may close these issues.

3 participants