Skip to content

response context limit randomly ignoredΒ #6265

@yggdrasil75

Description

@yggdrasil75

App Version

3.23.19

API Provider

OpenAI Compatible

Model Used

gemma 3 27b

Roo Code Task Links (Optional)

No response

πŸ” Steps to Reproduce

on linux, I am running VSC roo code extension, with koboldcpp as the backend, sometimes roo code will follow the setting in providers for maximum output, other times it will be ignored. I can not find a reasoning why. every api request should have that, but due to it not being sent every time, the koboldcpp fallback of 512 is used, which is not enough to provide a complete diff, erroring over and over on the same response until it gets a warning.
in koboldcpp I have a context limit of 32k and other applications that properly send a requested length with each request are setting the max context in kcpp fine.

πŸ’₯ Outcome Summary

expected a diff, got 1/3 of one.

πŸ“„ Relevant Logs or Errors (Optional)

Metadata

Metadata

Assignees

No one assigned

    Labels

    Issue - Needs InfoMissing details or unclear. Waiting on author to provide more context.bugSomething isn't working

    Type

    No type

    Projects

    Status

    Done

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions