Skip to content

Commit 3db4cb0

Browse files
committed
add ref to the PR
1 parent 9822f2c commit 3db4cb0

File tree

1 file changed

+1
-0
lines changed

1 file changed

+1
-0
lines changed

src/llama-kv-cache.cpp

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -761,6 +761,7 @@ ggml_tensor * llama_kv_cache_unified::build_rope_shift(
761761
// @ngxson : this is a workaround
762762
// for M-RoPE, we want to rotate the whole vector when doing KV shift
763763
// a normal RoPE should work, we just need to use the correct ordering
764+
// ref: https://github.com/ggml-org/llama.cpp/pull/13870
764765
? LLAMA_ROPE_TYPE_NEOX
765766
: hparams.rope_type;
766767

0 commit comments

Comments
 (0)