sync : ggml#2779

Merged

ggerganov merged 53 commits intomasterfrom

sync-ggml-25-02-03

Feb 3, 2025

Commits on Feb 3, 2025

ggml-cpu : fix ggml_graph_compute_thread did not terminate on abort. (ggml/1065)

authored and
ggerganov
committed
ggml : add option to not print stack on abort (ggml/1081)

authored and
ggerganov
committed
SYCL: Add gated linear attention kernel (llama/11175)

qnixsynapse
authored and
ggerganov
committed
RoPE: fix back, CUDA support for back + noncont. (llama/11240)

JohannesGaessler
authored and
ggerganov
committed
fix: ggml: fix vulkan-shaders-gen build (llama/10448)

sparkleholic
authored and
ggerganov
committed
vulkan: scale caching for k quants + misc fixes (llama/11081)

netrunnereve
authored and
ggerganov
committed
ggml: aarch64: implement SVE kernels for q4_K_q8_K vector dot (llama/11227)

fj-y-saito
and
ggerganov
committed
CUDA: backwards pass for misc. ops, add tests (llama/11257)

JohannesGaessler
authored and
ggerganov
committed
vulkan: optimize coopmat2 q2_k dequant function (llama/11130)

jeffbolznv
authored and
ggerganov
committed
vulkan: optimize coopmat2 q4_k/q5_k dequant functions. (llama/11206)

jeffbolznv
authored and
ggerganov
committed
vulkan: support copy from f32 to q4_0/q4_1/q5_0/q5_1/q8_0/iq4_nl (llama/11166)

jeffbolznv
authored and
ggerganov
committed
rpc : early register backend devices (llama/11262)

rgerganov
authored and
ggerganov
committed
vulkan: fix coopmat2 flash attention for non-contiguous inputs (llama/11281)

jeffbolznv
authored and
ggerganov
committed
cmake : add sanitizer flags for llama.cpp (llama/11279)

ggerganov
and
JohannesGaessler
committed
SYCL: Introducing memory host pool (llama/11251)

s-Nick
authored and
ggerganov
committed
vulkan: fix coopmat2 validation failures (llama/11284)

jeffbolznv
authored and
ggerganov
committed
metal : fix out-of-bounds write (llama/11314)
ggerganov
committed
rpc : better caching of the base buffer pointer (llama/11331)

rgerganov
authored and
ggerganov
committed
vulkan: fix diag_mask_inf (llama/11323)

jeffbolznv
authored and
ggerganov
committed
vulkan: sort shaders for more deterministic binary (llama/11315)

jeffbolznv
authored and
ggerganov
committed
Vulkan-run-test: fix mmq_wg_denoms (llama/11343)

AMD-dwang
authored and
ggerganov
committed
cmake : avoid -march=native when reproducible build is wanted (llama/11366)

bmwiedemann
authored and
ggerganov
committed
CPU/CUDA: fix (GQA) mul mat back, add CUDA support (llama/11380)

JohannesGaessler
authored and
ggerganov
committed
rocBLAS: Avoid fp32->fp16->fp32 conversion on cdna (llama/11356)

IMbackK
authored and
ggerganov
committed
CUDA: fix FP16 cuBLAS GEMM (llama/11396)

JohannesGaessler
authored and
ggerganov
committed
hip : Add hipGraph and VMM support to ROCM (llama/11362)

IMbackK
authored and
ggerganov
committed
Hip: disable VMM on hip as it seams that it dosent work in some configurations (llama/11420)

IMbackK
authored and
ggerganov
committed
vulkan: compile shaders on-demand (llama/11406)

jeffbolznv
authored and
ggerganov
committed
cmake: add ggml find package (llama/11369)

bandoti
and
ggerganov
committed
metal : use residency sets (llama/11427)
ggerganov
committed
metal: Handle null returned from MTLCreateSystemDefaultDevice() (llama/11441)

Ihar Hrachyshka
authored and
ggerganov
committed
AMD: parse the architecture as supplied by gcnArchName (llama/11244)

Haus1
authored and
ggerganov
committed
SYCL : SOFTMAX F16 mask support and other fixes (llama/11261)

qnixsynapse
authored and
ggerganov
committed
cmake : don't fail on `GGML_CPU=OFF` (llama/11457)

someone13574
authored and
ggerganov
committed
HIP: Only call rocblas_initialize on rocblas versions with the multiple instantation bug (llama/11080)

sARY77
authored and
ggerganov
committed
HIP: Supress transformation warning in softmax.cu

IMbackK
authored and
ggerganov
committed
vulkan: Catch pipeline creation failure and print an error message (llama/11436)

jeffbolznv
authored and
ggerganov
committed
vulkan: implement initial support for IQ2 and IQ3 quantizations (llama/11360)

authored and
ggerganov
committed
CUDA/HIP: add warp_size to cuda_device_info

IMbackK
authored and
ggerganov
committed
HIP: Prepare reduction operators for wave 64

IMbackK
authored and
ggerganov
committed
HIP: require at least HIP 5.5

IMbackK
authored and
ggerganov
committed
`ci`: use sccache on windows instead of ccache (llama/11545)

ochafik
authored and
ggerganov
committed
CUDA: use mma PTX instructions for FlashAttention (llama/11583)

authored and
ggerganov
committed
HIP: add GGML_CUDA_CC_IS_* for amd familys as increasing cc archtectures for amd gpus are not supersets of eatch other (llama/11601)

IMbackK
authored and
ggerganov
committed
CUDA/HIP: add support for selectable warp size to mmv (llama/11519)

IMbackK
authored and
ggerganov
committed
HIP: fix flash_attn_stream_k_fixup warning (llama/11604)

JohannesGaessler
authored and
ggerganov
committed
CUDA: fix Volta FlashAttention logic (llama/11615)

JohannesGaessler
authored and
ggerganov
committed
scripts : fix sync paths
ggerganov
committed
sync : ggml
ggerganov
committed
cmake : sync cmake scripts
ggerganov
committed
ci : use ubuntu-22.04 instead of ubuntu-latest
ggerganov
committed
ci : install git
ggerganov
committed
ci : more git
ggerganov
committed