Skip to content

Make custom @output_formatter the final LMI response #2993

Merged
ksuma2109 merged 2 commits intomasterfrom
output-formatters-final
Jan 26, 2026
Merged

Make custom @output_formatter the final LMI response #2993
ksuma2109 merged 2 commits intomasterfrom
output-formatters-final

Conversation

@ksuma2109
Copy link
Contributor

Description

Fixes 2986

Type of change

Please delete options that are not relevant.

  • Bug fix (non-breaking change which fixes an issue)
  • Breaking change (fix or feature that would cause existing functionality to not work as expected)
  • New feature (non-breaking change which adds functionality)
  • This change requires a documentation update

Checklist:

Feature/Issue validation/testing

Please describe the Unit or Integration tests that you ran to verify your changes and relevant result summary. Provide instructions so it can be reproduced.
Please also list any relevant details for your test configuration.

  • Test A
    Logs for Test A

  • Test B
    Logs for Test B

@ksuma2109 ksuma2109 requested review from a team and zachgk as code owners January 26, 2026 21:43
@ksuma2109 ksuma2109 merged commit 39ab90b into master Jan 26, 2026
34 of 37 checks passed
@ksuma2109 ksuma2109 deleted the output-formatters-final branch January 26, 2026 21:45
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Custom @output_formatter runs before LMI response formatter in vLLM async service, making it non-final / schema-constrained

2 participants