-
-
Notifications
You must be signed in to change notification settings - Fork 9.5k
Open
Labels
feature requestNew feature or requestNew feature or requestgood first issueGood for newcomersGood for newcomershelp wantedExtra attention is neededExtra attention is neededunstaleRecieved activity after being labelled staleRecieved activity after being labelled stale
Description
π The feature, motivation and pitch
Improve logging on VLLM V1 for common errors in initialization.
For example:
- not enough memory to fit the model
- not enough kv cache space to fit the model
- ...
Currently we have decently logging of the exceptions that arise. It would be better however if we could explicitly catch these issues and return clearer error messages
Alternatives
No response
Additional context
No response
Before submitting a new issue...
- Make sure you already searched for relevant issues, and asked the chatbot living at the bottom right corner of the documentation page, which can answer lots of frequently asked questions.
anencore94
Metadata
Metadata
Assignees
Labels
feature requestNew feature or requestNew feature or requestgood first issueGood for newcomersGood for newcomershelp wantedExtra attention is neededExtra attention is neededunstaleRecieved activity after being labelled staleRecieved activity after being labelled stale
Type
Projects
Status
Todo