Skip to content

Commit b6d63bb

Browse files
authored
[v0.11.0-dev][CI] Fix ngram lacking of input arg dummy_compute_logits error (#4648)
### What this PR does / why we need it? Fix ngram lacking of input arg `dummy_compute_logits` error ### How was this patch tested? CI passed with existing test. --------- Signed-off-by: MengqingCao <[email protected]>
1 parent 865f1f7 commit b6d63bb

File tree

2 files changed

+4
-2
lines changed

2 files changed

+4
-2
lines changed

vllm_ascend/spec_decode/interface.py

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -35,7 +35,8 @@ def dummy_run(self,
3535
num_reqs: int = 0,
3636
num_tokens_across_dp: Optional[torch.Tensor] = None,
3737
aclgraph_runtime_mode: CUDAGraphMode = CUDAGraphMode.NONE,
38-
batch_descriptor=None):
38+
batch_descriptor=None,
39+
dummy_compute_logits=lambda hidden_states: None):
3940
"""Called by dummy_run in modle_runner"""
4041
raise NotImplementedError
4142

vllm_ascend/spec_decode/ngram_proposer.py

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -26,7 +26,8 @@ def dummy_run(self,
2626
num_reqs=None,
2727
num_tokens_across_dp=None,
2828
aclgraph_runtime_mode: CUDAGraphMode = CUDAGraphMode.NONE,
29-
batch_descriptor=None):
29+
batch_descriptor=None,
30+
dummy_compute_logits=lambda hidden_states: None):
3031
pass
3132

3233
def generate_token_ids(self,

0 commit comments

Comments
 (0)