Skip to content

Commit ed4d687

Browse files
committed
Fix unrecognized parallelism parameters for vLLM engine
Signed-off-by: Bradley <bradley.b.pitt@gmail.com>
1 parent 5e2cacc commit ed4d687

File tree

1 file changed

+2
-5
lines changed

1 file changed

+2
-5
lines changed

vllm_omni/model_executor/stage_configs/hunyuan_image_3_moe.yaml

Lines changed: 2 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -19,11 +19,8 @@ stage_args:
1919
engine_output_type: latent
2020
enable_prefix_caching: false
2121
max_num_batched_tokens: 32768
22-
parallel_config:
23-
tensor_parallel_size: 1
24-
pipeline_parallel_size: 1
25-
data_parallel_size: 1
26-
sequence_parallel_size: 1
22+
tensor_parallel_size: 5
23+
pipeline_parallel_size: 1
2724
is_comprehension: true
2825
final_output: true
2926
final_output_type: text

0 commit comments

Comments
 (0)