Skip to content

Commit b9b3b00

Browse files
fix non-working disaggregated prefill
Signed-off-by: CaveNightingale <[email protected]>
1 parent e14f2ef commit b9b3b00

File tree

1 file changed

+7
-2
lines changed

1 file changed

+7
-2
lines changed

vllm_ascend/worker/model_runner_v1.py

Lines changed: 7 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -1858,8 +1858,13 @@ def kv_connector_no_forward(
18581858
return EMPTY_MODEL_RUNNER_OUTPUT
18591859

18601860
output = copy.copy(EMPTY_MODEL_RUNNER_OUTPUT)
1861-
output.finished_sending = finished_sending
1862-
output.finished_recving = finished_recving
1861+
if vllm_version_is("0.10.0"):
1862+
output.finished_sending = finished_sending
1863+
output.finished_recving = finished_recving
1864+
else:
1865+
output.kv_connector_output = KVConnectorOutput(
1866+
finished_sending=finished_sending,
1867+
finished_recving=finished_recving)
18631868
return output
18641869

18651870
@staticmethod

0 commit comments

Comments
 (0)