You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Implementation of LlamaBatch::get_one is unsound, the tokens are not copied but they are simply turned into a pointer. I think that also contradicts the comment on the field of the raw batch:
always initialize by `llama_cpp_sys_2::llama_batch_init