[CANN] Optimize CANN buffer pool memory management#12875

hipudding merged 4 commits intoggml-org:masterggml-org/llama.cpp:masterfrom

bachelor-dou:testbachelor-dou/llama.cpp:testCopy head branch name to clipboard