Replies: 1 comment
-
Yes you can set any context value you want. The slider is just for convenience. --contextsize 20000 is perfectly fine |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
-
I'm noticing the ctx is on a fixed slider, and offers 16384 and 24576 but is there an in-between option? I know via Runpod I can run this flag:
--contextsize x
Where x equals the desired context, but can it be an in-between value?
Beta Was this translation helpful? Give feedback.
All reactions