Replies: 1 comment
-
You can have a wrapper callback that calls the callback that you want |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
I'd like to be able to change
cb_eval
andcb_eval_user_data
prior to callingllama_decode
, per-call, to track decoding progress with different callbacks. Currently it's a part ofllama_context.cparams
. Exposing the whole.cparams
field doesn't seem to be viable, but changing these two is required in my use-case. Any workarounds?Beta Was this translation helpful? Give feedback.
All reactions