sync : llama.cpp#1020

Merged

ggerganov merged 17 commits intomasterfrom

Nov 18, 2024

Commits on Nov 17, 2024

Make updates to fix issues with clang-cl builds while using AVX512 flags (llama/10314)

Srihari-mcw
authored and
ggerganov
committed
ggml : optimize Q4_0 into Q4_0_X_Y repack (llama/10324)

eddnjjn
authored and
ggerganov
committed
vulkan: Optimize some mat-vec mul quant shaders (llama/10296)

jeffbolznv
authored and
ggerganov
committed
llamafile : fix include path (llama/0)
ggerganov
committed
ggml : fix compile warnings (llama/0)
ggerganov
committed
ggml : adapt AMX to tensor->grad removal (llama/0)
ggerganov
committed
ggml : inttypes.h -> cinttypes (llama/0)
ggerganov
committed
ggml : fix possible buffer use after free in sched reserve (llama/9930)

slaren
authored and
ggerganov
committed
CMake: default to -arch=native for CUDA build (llama/10320)

JohannesGaessler
authored and
ggerganov
committed
CUDA: remove DMMV, consolidate F16 mult mat vec (llama/10318)

JohannesGaessler
authored and
ggerganov
committed
ggml : fix undefined reference to 'getcpu' (llama/10354)

FirstTimeEZ
authored and
ggerganov
committed
metal : refactor kernel args into structs (llama/10238)
ggerganov
committed
llama : only use default buffer types for the KV cache (llama/10358)

slaren
authored and
ggerganov
committed
CMake: fix typo in comment [no ci] (llama/10360)

JohannesGaessler
authored and
ggerganov
committed
sync : llama.cpp
ggerganov
committed

Commits on Nov 18, 2024

CUDA: fix MMV kernel being used for FP16 src1 (llama/10357)

JohannesGaessler
authored and
ggerganov
committed
sync : llama.cpp
ggerganov
committed