CUDA: faster prompt processing for 4-bit quants#713

ikawrakow merged 2 commits intomainikawrakow/ik_llama.cpp:mainfrom

ik/cuda_use_bpermikawrakow/ik_llama.cpp:ik/cuda_use_bpermCopy head branch name to clipboard