Skip to content

Commit 6b794c7

Browse files
authored
[Nixl][CI] Fix tests (#22806)
Signed-off-by: NickLucche <[email protected]>
1 parent 98deac3 commit 6b794c7

File tree

1 file changed

+3
-0
lines changed

1 file changed

+3
-0
lines changed

tests/v1/kv_connector/unit/test_nixl_connector.py

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -229,6 +229,9 @@ def _nixl_handshake(self, host: str, port: int, remote_tp_size: int,
229229
num_blocks=1,
230230
block_len=self.block_len,
231231
attn_backend_name=self.backend_name,
232+
# `self.kv_cache_layout` is only forced to HND when vllm engine
233+
# is started. We mock HND here.
234+
kv_cache_layout="HND",
232235
),
233236
remote_tp_size=remote_tp_size)
234237
return {0: remote_agent_name}

0 commit comments

Comments
 (0)