CUDA: compress-mode size#12029

Green-Sky merged 1 commit intoggml-org:masterggml-org/llama.cpp:masterfrom

Green-Sky:cuda_compressGreen-Sky/llama.cpp:cuda_compressCopy head branch name to clipboard