Skip to content

[Bug]: OmniModelConfig mismatch with vllm main [not yet in released vllm 0.16.0] #1440

@divyanshsinghvi

Description

@divyanshsinghvi

Your current environment

The output of python collect_env.py
Your output of `python collect_env.py` here

Your code version

The commit id or version of vllm

The commit id or version of vllm-omni

🐛 Describe the bug

vllm_omni/engine/arg_utils.py

Migrating vllm-omni to support vllm 0.16.0 missed removing

logits_processor_pattern=self.logits_processor_pattern,

but correctly added the parameter logits_processors=self.logits_processors (the new name)

Add new parameter :

language_model_only=language_model_only,

Before submitting a new issue...

  • Make sure you already searched for relevant issues, and asked the chatbot living at the bottom right corner of the documentation page, which can answer lots of frequently asked questions.

Metadata

Metadata

Assignees

Labels

bugSomething isn't working

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions