Skip to content

Commit 0e93ac0

Browse files
authored
[CI] Fix distributed hybrid tests in CI (vllm-project#26155)
Signed-off-by: Thomas Parnell <[email protected]>
1 parent 5446ad1 commit 0e93ac0

File tree

1 file changed

+2
-2
lines changed

1 file changed

+2
-2
lines changed

tests/models/language/generation/test_hybrid.py

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -240,12 +240,12 @@ def test_distributed_correctness(
240240
num_logprobs: int,
241241
) -> None:
242242
with vllm_runner(model, tensor_parallel_size=1,
243-
max_num_seqs=2) as vllm_model:
243+
max_num_seqs=MAX_NUM_SEQS) as vllm_model:
244244
vllm_outputs_tp_1 = vllm_model.generate_greedy_logprobs(
245245
example_prompts, max_tokens, num_logprobs)
246246

247247
with vllm_runner(model, tensor_parallel_size=2,
248-
max_num_seqs=2) as vllm_model:
248+
max_num_seqs=MAX_NUM_SEQS) as vllm_model:
249249
vllm_outputs_tp_2 = vllm_model.generate_greedy_logprobs(
250250
example_prompts, max_tokens, num_logprobs)
251251

0 commit comments

Comments
 (0)