Skip to content

Conversation

@domsolutions
Copy link
Contributor

Motivation

Logging every inference request by default can be expensive and add needless latency, especially under high load.

Summary of changes

  • new env var on helm charts to disable inference logging MLSERVER_DEBUG default to false. Note if it is not set, debug will be enabled by default.

Checklist

  • Added/updated unit tests
  • Added/updated documentation
  • Checked for typos in variable names, comments, etc.
  • Added licences for new files

Testing

@domsolutions domsolutions requested a review from lc525 as a code owner December 18, 2025 17:39
Copy link
Member

@lc525 lc525 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm

@domsolutions domsolutions merged commit 96ce155 into v2 Dec 18, 2025
5 checks passed
@domsolutions domsolutions deleted the turn-off-debug-mlserver branch December 18, 2025 18:02
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants