Skip to content

[Feature]: Support transformers>=5Ā #30466

@Whadup

Description

@Whadup

šŸš€ The feature, motivation and pitch

vllm requires transformers<5, but some new models already require transformers 5.0.0rc0.
The combination of vllm>=0.12 and transformers>=5.0.0rc0 cannot be resolved.

Ignoring the constraint and installing transformers 5 anyways works, so hopefully supporting it officially is not a lot of work.

Alternatives

No response

Additional context

No response

Before submitting a new issue...

  • Make sure you already searched for relevant issues, and asked the chatbot living at the bottom right corner of the documentation page, which can answer lots of frequently asked questions.

Metadata

Metadata

Assignees

Labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions