Skip to content

Commit e4e1418

Browse files
committed
Revert "disable caching in kv_manager to fix second identical request failed error"
This reverts commit 5702cc8.
1 parent 5702cc8 commit e4e1418

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

vllm/v1/core/kv_cache_manager.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -68,7 +68,7 @@ def __init__(
6868
self,
6969
kv_cache_config: KVCacheConfig,
7070
max_model_len: int,
71-
enable_caching: bool = False,
71+
enable_caching: bool = True,
7272
caching_hash_algo: str = "builtin",
7373
use_eagle: bool = False,
7474
log_stats: bool = False,

0 commit comments

Comments
 (0)