llama : add high-throughput mode#14363

ggerganov merged 17 commits intomasterggml-org/llama.cpp:masterfrom

gg/llama-high-throughputggml-org/llama.cpp:gg/llama-high-throughputCopy head branch name to clipboard