Skip to content

Commit e03b3a6

Browse files
committed
add comments
Signed-off-by: Kobe Chen <[email protected]>
1 parent 4265fdb commit e03b3a6

File tree

1 file changed

+16
-1
lines changed

1 file changed

+16
-1
lines changed

tests/e2e/router-stress-test.sh

Lines changed: 16 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,7 +1,22 @@
11
#!/bin/bash
22

3-
# Simple Router Stress Test
3+
# Router Stress Test - Pure Router Logic Testing
44
# Tests round-robin routing logic under high concurrent loads
5+
#
6+
# IMPORTANT NOTES:
7+
# - This test uses MOCK backends and MOCK responses (no real vLLM servers)
8+
# - Backend ports are dummy placeholders - no actual services run on them
9+
# - Model names are dummy placeholders - no real models are loaded
10+
# - When VLLM_ROUTER_STRESS_TEST_MODE=true, the router returns mock responses
11+
# instead of forwarding requests to backends (see src/vllm_router/services/request_service/request.py)
12+
# - This test validates ONLY the router's routing logic, load balancing, and performance
13+
# under high concurrent loads, not actual inference capabilities
14+
#
15+
# Purpose: Verify that the router correctly distributes requests using round-robin
16+
# logic and can handle high concurrency without routing logic failures.
17+
#
18+
# TODO: will add tests for prefix-aware and session-based router later
19+
# TODO: will add performance comparison tests & threshold later
520

621
set -euo pipefail
722

0 commit comments

Comments
 (0)