Skip to content

[Feature]: Improve Logging for Error MessagesΒ #14083

@robertgshaw2-redhat

Description

@robertgshaw2-redhat

πŸš€ The feature, motivation and pitch

Improve logging on VLLM V1 for common errors in initialization.

For example:

  • not enough memory to fit the model
  • not enough kv cache space to fit the model
  • ...

Currently we have decently logging of the exceptions that arise. It would be better however if we could explicitly catch these issues and return clearer error messages

Alternatives

No response

Additional context

No response

Before submitting a new issue...

  • Make sure you already searched for relevant issues, and asked the chatbot living at the bottom right corner of the documentation page, which can answer lots of frequently asked questions.

Metadata

Metadata

Assignees

No one assigned

    Labels

    feature requestNew feature or requestgood first issueGood for newcomershelp wantedExtra attention is neededunstaleRecieved activity after being labelled stale

    Projects

    Status

    Todo

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions