Skip to content

[Refactor] guidellm.benchmark package rewrite #332

@markurtz

Description

@markurtz

Updates and refactors for the GuideLLM platform rewrite within the guidellm.benchmark package including improvements to the benchmarker and entrypoints logic for better, more performant parallelization and the additions of aggregators, outputs, and profile expansions for a more pluggable framework

Metadata

Metadata

Assignees

Labels

Projects

No projects

Milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions