Skip to content

Conversation

@rudeigerc
Copy link
Contributor

@rudeigerc rudeigerc commented Dec 5, 2025

This PR adds support for the X-Request-Id header, enabling request tracing across the LLM inference simulation server, aligning with extra HTTP headers of vLLM's OpenAI-compatible server feature. The update also provides the --enable-request-id-headers flag that vLLM offers.

Related vLLM PRs:

Currently, only X-Request-Id is supported since ctx.Request.Header.Peek from fasthttp is case-sensitive.

Copy link
Collaborator

@mayabar mayabar left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for the PR, please see some comments

@rudeigerc
Copy link
Contributor Author

@mayabar Thanks for the review! The addressed issues have been updated.

Copy link
Collaborator

@mayabar mayabar left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

/lgtm

@rudeigerc Please fix the lint problem

@rudeigerc
Copy link
Contributor Author

rudeigerc commented Dec 8, 2025

@mayabar Linted :)

By the way, I'm unable to build or lint the package locally on macOS after #261. A virtual environment with Python interpreter via uv may be helpful as an alternative to using the local Python environment.

Copy link
Collaborator

@mayabar mayabar left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

/lgtm
/approve

@mayabar
Copy link
Collaborator

mayabar commented Dec 9, 2025

/lgtm
/approve

@github-actions github-actions bot added the lgtm label Dec 9, 2025
@mayabar mayabar merged commit f79439e into llm-d:main Dec 9, 2025
4 checks passed
@rudeigerc rudeigerc deleted the feat/request-id branch December 9, 2025 07:51
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants