Skip to content

Support fractional specification of maxtokens #203

@vsiegel

Description

@vsiegel

For example, 2/3 to set maxtokens to two thirds of the maximum value of the current model.
After a model change to a model with a maximum twice as high, the maxtokens increases by factor 2 too.

Metadata

Metadata

Assignees

Labels

enhancementNew feature or request that refines or completes the current scope

Projects

No projects

Relationships

None yet

Development

No branches or pull requests

Issue actions