No option to set API timeout! #6445
openSourcerer9000
started this conversation in
Feature Requests
Replies: 1 comment
-
Would also really like to see this! Roo code keeps timing out on my slow, local models |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
I can configure everything else about the API, But the default API timeout is just too aggressive for large, slow local models, where processing the gigantic system prompt takes longer than the default timeout. I'm trying the new qwen coder 480b which actually gets fantastic tokens per second because it's moe, but I simply can't use it because roo doesn't have patience to wait for it to process its system prompt. if there's already a way to do this from the gui, please let me know
in the meantime, how can I hack the hard coded timeout setting? Where does it live in the codebase? is there a guide to forking roo and using the fork with VSCode? thanks
Beta Was this translation helpful? Give feedback.
All reactions