server : dynamic token limit for prompt cache#16560

ggerganov merged 2 commits intomasterggml-org/llama.cpp:masterfrom

gg/server-dynamic-token-limit-for-prompt-cacheggml-org/llama.cpp:gg/server-dynamic-token-limit-for-prompt-cacheCopy head branch name to clipboard