We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
1 parent ed7c2e0 commit fe1bb4fCopy full SHA for fe1bb4f
src/llama-kv-cache-unified.cpp
@@ -633,7 +633,7 @@ llama_kv_cache_unified::slot_info llama_kv_cache_unified::find_slot(const llama_
633
634
// (disabled) causal mask
635
// note: it's better to purge any "future" tokens beforehand
636
- //if (cells.seq_has(idx)) {
+ //if (cells.seq_has(idx, seq_id)) {
637
// can_use = pos_cell >= pos;
638
//}
639
0 commit comments