Additional latency related metrics#237

Merged

irar2 merged 14 commits intollm-d:mainfrom

mayabar:latency-metrics

Oct 29, 2025

Commits on Oct 28, 2025

Add e2e request latency histogram to prometheus metrics.
mayabar
committed
Additional metrics - vllm:request_queue_time_seconds, vllm:request_inference_time_seconds, vllm:request_prefill_time_seconds, and vllm:request_decode_time_seconds
mayabar
committed
typo in metric name
mayabar
committed
Initial tests for new metrics + create constant for part of metrics names
mayabar
committed
Fix bug in metrics test + add latency test for streaming mode
mayabar
committed
Move common simulator tests helper functions to test_utils.go, use same model name is all tests, refactoring in server start functions
mayabar
committed
Add test for vllm:request_queue_time_seconds and vllm:request_inference_time_seconds
mayabar
committed
Define constant for metrics names, use helper functions in metrics test for histogram buckets validation
mayabar
committed
- Add full list of supported metrics to readme
mayabar
committed
add license to test_utils.go
mayabar
committed
Set fake latency metrics if defined in configuration, added tests for latency fake metrics
mayabar
committed
add fake latency metrics test
mayabar
committed
fix sending latency metrics, use WriteToChannel function
mayabar
committed
fix merge
mayabar
committed