Skip to content

Add inference scheduler config to v0.2 benchmark report#626

Merged
maugustosilva merged 5 commits intollm-d:mainfrom
namasl:br-is
Jan 28, 2026
Merged

Add inference scheduler config to v0.2 benchmark report#626
maugustosilva merged 5 commits intollm-d:mainfrom
namasl:br-is

Conversation

@namasl
Copy link
Collaborator

@namasl namasl commented Jan 28, 2026

When modelservice is used, add inference scheduler configuration to the component stack of the v0.2 benchmark report.

This PR also includes fixes:

  • When an environment variable expected to have base64 encoded data is malformed, handle this by printing an error message to stdout but continue to run
  • Make corrections/cleanup to the base class for stack components

This PR is ready, with the caveat of #627

Signed-off-by: Nick Masluk <nick@randombytes.net>
Signed-off-by: Nick Masluk <nick@randombytes.net>
Signed-off-by: Nick Masluk <nick@randombytes.net>
Signed-off-by: Nick Masluk <nick@randombytes.net>
Signed-off-by: Nick Masluk <nick@randombytes.net>
@namasl namasl marked this pull request as ready for review January 28, 2026 01:49
@maugustosilva maugustosilva self-requested a review January 28, 2026 21:57
@maugustosilva maugustosilva merged commit b24ce7a into llm-d:main Jan 28, 2026
8 checks passed
@namasl namasl deleted the br-is branch January 29, 2026 19:19
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants