Saw they finally merged upstream support: https://github.com/ggml-org/llama.cpp/pull/17713 Please consider including it in the new release!