How to log the user specific metrics such user id from the inference request?

[vinayK34]

I am trying to log the user specific metric with the other vLLM metrics and scrap it a /metrics using Prometheus. but I have difficulties to understand the data flow. Can someone help me here?

[PatrykWo]

Have you tried the standard logging mechanism exposed by vLLM?
https://docs.vllm.ai/en/stable/getting_started/examples/logging_configuration.html
https://docs.vllm.ai/en/v0.6.1/serving/metrics.html