Skip to content

Commit 9302236

Browse files
committed
docs fix
1 parent d12da2e commit 9302236

File tree

1 file changed

+1
-1
lines changed
  • docs/my-website/release_notes/v1.77.5-stable

1 file changed

+1
-1
lines changed

docs/my-website/release_notes/v1.77.5-stable/index.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -61,7 +61,7 @@ pip install litellm==1.77.5
6161

6262
Throughput increased by 54% (1,040 → 1,602 RPS, aggregated) per instance while maintaining a 40 ms median overhead. The improvement comes from fixing major O(n²) inefficiencies in the router, primarily caused by repeated use of in statements inside loops over large arrays. Tests were run with a database-only setup (no cache hits). As a result, p95 latency improved by 30% (2,700 → 1,900 ms), enhancing overall stability and scalability under heavy load.
6363

64-
### Test Setup
64+
#### Test Setup
6565

6666
All benchmarks were executed using Locust with 1,000 concurrent users and a ramp-up of 500. The environment was configured to stress the routing layer and eliminate caching as a variable.
6767

0 commit comments

Comments
 (0)