Skip to content

Commit c8d0d14

Browse files
authored
kv-cache : fix find_slot to not search for continuous slot (ggml-org#15638)
ggml-ci
1 parent 84ab83c commit c8d0d14

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

src/llama-kv-cache.cpp

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -540,7 +540,7 @@ llama_kv_cache::slot_info_vec_t llama_kv_cache::prepare(const std::vector<llama_
540540

541541
for (const auto & ubatch : ubatches) {
542542
// only find a suitable slot for the ubatch. don't modify the cells yet
543-
const auto sinfo_new = find_slot(ubatch, true);
543+
const auto sinfo_new = find_slot(ubatch, false);
544544
if (sinfo_new.empty()) {
545545
success = false;
546546
break;

0 commit comments

Comments
 (0)