maxContextTokens for existing EndPoint (OpenAI)? #4004
ViolentVotan
started this conversation in
Help Wanted
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Hi there,
I googled and found on the wiki on how to set maxContextTokens for custom endpoints in the yaml, but how can I set a maxContextTokens for the standard OpenAI endpoint?
I want that all my users are automatically set to a set maxContextTokens value without them having to set it on every new chat.
Beta Was this translation helpful? Give feedback.
All reactions