Enable per-conversation loading states to allow having parallel conversations#16327

allozaur wants to merge 7 commits intoggml-org:masterggml-org/llama.cpp:masterfrom

allozaur:16133-parallel-streamingallozaur/llama.cpp:16133-parallel-streamingCopy head branch name to clipboard