File tree Expand file tree Collapse file tree 1 file changed +16
-1
lines changed Expand file tree Collapse file tree 1 file changed +16
-1
lines changed Original file line number Diff line number Diff line change 1
1
#! /bin/bash
2
2
3
- # Simple Router Stress Test
3
+ # Router Stress Test - Pure Router Logic Testing
4
4
# Tests round-robin routing logic under high concurrent loads
5
+ #
6
+ # IMPORTANT NOTES:
7
+ # - This test uses MOCK backends and MOCK responses (no real vLLM servers)
8
+ # - Backend ports are dummy placeholders - no actual services run on them
9
+ # - Model names are dummy placeholders - no real models are loaded
10
+ # - When VLLM_ROUTER_STRESS_TEST_MODE=true, the router returns mock responses
11
+ # instead of forwarding requests to backends (see src/vllm_router/services/request_service/request.py)
12
+ # - This test validates ONLY the router's routing logic, load balancing, and performance
13
+ # under high concurrent loads, not actual inference capabilities
14
+ #
15
+ # Purpose: Verify that the router correctly distributes requests using round-robin
16
+ # logic and can handle high concurrency without routing logic failures.
17
+ #
18
+ # TODO: will add tests for prefix-aware and session-based router later
19
+ # TODO: will add performance comparison tests & threshold later
5
20
6
21
set -euo pipefail
7
22
You can’t perform that action at this time.
0 commit comments