Commit 73460f6
ggml-cpu: templateify ggml_compute_forward_rope_f32 and _f16 (ggml-org#16805)
* extract rotate_pairs logic from ggml_compute_forward_rope_f32
* templateify ggml_compute_forward_rope_f32 and _f16
* abort when rope type not supported, remove GLM from test-rope
* add imrope branch to switch
* add rope tests for perf
* Update ggml/src/ggml-cpu/ops.cpp
Co-authored-by: Georgi Gerganov <[email protected]>
* Update ggml/src/ggml-cpu/ops.cpp
Co-authored-by: Georgi Gerganov <[email protected]>
---------
Co-authored-by: Georgi Gerganov <[email protected]>1 parent 8c58324 commit 73460f6
File tree
3 files changed
+76
-268
lines changed- ggml/src/ggml-cpu
- tests
3 files changed
+76
-268
lines changed
0 commit comments