Track input and output length on vLLM dashboard #6974
Description
We need this after pytorch/pytorch-integration-testing#42, I'm creating this issue to track this missing feature on vLLM dashboard
cc @BoyuanFeng
Metadata
Metadata
Assignees
Labels
No labels
Type
Projects
Status