Continue generation missing a parameter

[Originalimoc]

What happened?

This: theroyallab/tabbyAPI#276

Code of Conduct

• I agree to follow this project's Code of Conduct

[danny-avila]

There is simply not enough information here to determine what you're specifying, and you're linking to another project's issue.

[Originalimoc]

There is simply not enough information here to determine what you're specifying, and you're linking to another project's issue.

When you click stop generation, there will be an additional continue generation button which won't appear if you let the generation finish itself. That button should trigger a generation request contains the specific parameter in another project's issue closing comment or the HF endpoint will assume it's a new round and model will not behave as what continue generation intended. It's called "Prefilled" generation request. Another use case of this feature is model steering.