[Feat] add time-windowed endpoint metrics for load balancing#742

rootfs merged 3 commits intovllm-project:mainvllm-project/semantic-router:mainfrom

tao12345666333:feat-time-windowed-ep-metricstao12345666333/semantic-router:feat-time-windowed-ep-metricsCopy head branch name to clipboard