Skip to content

Commit e0b2a94

Browse files
authored
[None][fix] Fix ready signal in NIXL backend (#10000)
Signed-off-by: Chuang Zhu <111838961+chuangz0@users.noreply.github.com>
1 parent 2e88c86 commit e0b2a94

File tree

2 files changed

+3
-1
lines changed

2 files changed

+3
-1
lines changed

cpp/tensorrt_llm/executor/cache_transmission/agent_utils/connection.cpp

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -231,7 +231,7 @@ bool AgentConnection::recvReadySignal(DataContext const& ctx) const
231231
{
232232
ReadySignalInfo readySignalInfo{mAgentName, ctx, false};
233233
mAgentConnectionManager->waitForReadySignal(mRemoteAgentName, readySignalInfo);
234-
return true;
234+
return readySignalInfo.mIsReady;
235235
}
236236

237237
AgentConnectionManager::AgentConnectionManager(

tests/integration/test_lists/test-db/l0_sanity_check.yml

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -34,3 +34,5 @@ l0_sanity_check:
3434
- examples/test_llm_api_with_mpi.py::test_llm_api_single_gpu_with_mpirun[TinyLlama-1.1B-Chat-v1.0] ISOLATION
3535
- unittest/others/test_kv_cache_transceiver.py::test_kv_cache_transceiver_single_process[NIXL-mha-ctx_fp16_gen_fp16]
3636
- unittest/others/test_kv_cache_transceiver.py::test_kv_cache_transceiver_single_process[UCX-mha-ctx_fp16_gen_fp16]
37+
- unittest/others/test_kv_cache_transceiver.py::test_cancel_request_in_transmission[mha]
38+
- unittest/others/test_kv_cache_transceiver.py::test_cancel_request_in_transmission[mla]

0 commit comments

Comments
 (0)