Skip to content

[AutoDeploy]: use vLLM as a performance reference for models without a trtllm implementation #7040

@nzmora-nvidia

Description

@nzmora-nvidia

🚀 The feature, motivation and pitch

Use this in the performance dashboard

Alternatives

No response

Additional context

No response

Before submitting a new issue...

  • Make sure you already searched for relevant issues, and checked the documentation and examples for answers to frequently asked questions.

Metadata

Metadata

Assignees

Labels

AutoDeploy<NV> AutoDeploy BackendduplicateThis issue or pull request already exists

Type

No type

Projects

Status

Done

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions