ggml: avoid rebuild of GGML graph for each token (#7456)#8366

agray3 wants to merge 1 commit intoggml-org:masterggml-org/llama.cpp:masterfrom

agray3:ag_ggml_graph_cachingagray3/llama.cpp:ag_ggml_graph_cachingCopy head branch name to clipboard