Skip to content

[Refactor] guidellm.scheduler rewrite and tests #331

@markurtz

Description

@markurtz

Updates and refactors for the GuideLLM platform rewrite within the guidellm.scheduler package including improvements to the scheduler and worker logic for better, more performant parallelization and the additions of constraints and request timings for a more pluggable framework

Metadata

Metadata

Assignees

Labels

Projects

No projects

Milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions