Skip to content

Commit 239b583

Browse files
author
wangzaijun
committed
fix
1 parent 07625ee commit 239b583

File tree

1 file changed

+2
-2
lines changed

1 file changed

+2
-2
lines changed

lightllm/server/multi_level_kv_cache/cpu_cache_client.py

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -210,8 +210,8 @@ def get_pages_to_offloading(self) -> List[List[int]]:
210210
page_items = self.page_items.linked_items
211211
index = 0
212212
while index < len(page_list):
213-
group_size = page_list[0]
214-
groups.append(page_list[1 : 1 + group_size])
213+
group_size = page_list[index]
214+
groups.append(page_list[index + 1 : index + 1 + group_size])
215215
for page_index in groups[-1]:
216216
page_item: _CpuPageStatus = page_items[page_index]
217217
page_item.ref_count += 1

0 commit comments

Comments
 (0)