Skip to content

Commit e9c073c

Browse files
committed
fix
1 parent 8d9068b commit e9c073c

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

lightllm/common/mem_utils.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -11,7 +11,7 @@
1111

1212
def select_mem_manager_class(mode):
1313
logger.info(f"mode setting params: {mode}")
14-
if "ppl_int8kv" in mode or "ppl_int8kv_flashdecoding" in mode:
14+
if "ppl_int8kv" in mode or "ppl_int8kv_flashdecoding" in mode or "ppl_int8kv_flashdecoding_diverse" in mode:
1515
memory_manager_class = PPLINT8KVMemoryManager
1616
logger.info(f"Model kv cache using mode {mode}")
1717
elif "ppl_int4kv_flashdecoding" in mode:

0 commit comments

Comments
 (0)