Skip to content

Commit b2dd50d

Browse files
committed
docs key rotations
1 parent e58c2c5 commit b2dd50d

File tree

2 files changed

+18
-1
lines changed

2 files changed

+18
-1
lines changed
603 KB
Loading

docs/my-website/release_notes/v1.77.5-stable/index.md

Lines changed: 18 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -57,13 +57,30 @@ pip install litellm==1.77.5
5757

5858
---
5959

60+
### Scheduled Key Rotations
61+
62+
<Image img={require('../../img/release_notes/schedule_key_rotations.png')} style={{ width: '800px', height: 'auto' }} />
63+
64+
<br/>
65+
66+
This release brings support for scheduling virtual key rotations on LiteLLM AI Gateway.
67+
68+
This is great for Proxy Admins looking to enforce Enterprise Grade security for use cases going through LiteLLM AI Gateway.
69+
70+
From this release you can enforce Virtual Keys to rotate ona schedule of your choice e.g every 15 days/30 days/60 days etc.
71+
72+
---
6073
### Performance Improvements - 54% RPS Improvement
6174

6275
<Image img={require('../../img/release_notes/perf_77_5.png')} style={{ width: '800px', height: 'auto' }} />
6376

6477
<br/>
6578

66-
Throughput increased by 54% (1,040 → 1,602 RPS, aggregated) per instance while maintaining a 40 ms median overhead. The improvement comes from fixing major O(n²) inefficiencies in the router, primarily caused by repeated use of in statements inside loops over large arrays. Tests were run with a database-only setup (no cache hits). As a result, p95 latency improved by 30% (2,700 → 1,900 ms), enhancing overall stability and scalability under heavy load.
79+
This release brings a 54% RPS improvement (1,040 → 1,602 RPS, aggregated) per instance.
80+
81+
The improvement comes from fixing O(n²) inefficiencies in the LiteLLM Router, primarily caused by repeated use of `in` statements inside loops over large arrays.
82+
83+
Tests were run with a database-only setup (no cache hits).
6784

6885
#### Test Setup
6986

0 commit comments

Comments
 (0)