Skip to content

Commit b011825

Browse files
author
liujiacheng
committed
add multi_level_kv_cache start
1 parent 4cc6d08 commit b011825

File tree

1 file changed

+10
-0
lines changed

1 file changed

+10
-0
lines changed

lightllm/server/api_start.py

Lines changed: 10 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -296,6 +296,16 @@ def normal_or_p_d_start(args):
296296
],
297297
)
298298

299+
if args.enable_cpu_cache:
300+
from .multi_level_kv_cache.manager import start_multi_level_kv_cache_manager
301+
302+
process_manager.start_submodule_processes(
303+
start_funcs=[
304+
start_multi_level_kv_cache_manager,
305+
],
306+
start_args=[(args,)],
307+
)
308+
299309
process_manager.start_submodule_processes(
300310
start_funcs=[
301311
start_metric_manager,

0 commit comments

Comments
 (0)