Skip to content

Commit bd2559e

Browse files
committed
docs fix
1 parent 525b866 commit bd2559e

File tree

1 file changed

+1
-3
lines changed
  • docs/my-website/release_notes/v1.77.7-stable

1 file changed

+1
-3
lines changed

docs/my-website/release_notes/v1.77.7-stable/index.md

Lines changed: 1 addition & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -65,12 +65,10 @@ pip install litellm==1.77.7.rc.1
6565
- **AMD Lemonade & Nvidia NIM** - New provider support for AMD Lemonade and Nvidia NIM Rerank
6666
- **GitLab Prompt Management** - GitLab-based prompt management integration
6767

68-
### 2.9x Lower Median Latency
68+
### Performance - 2.9x Lower Median Latency
6969

7070
<Image img={require('../../img/release_notes/perf_77_7.png')} style={{ width: '800px', height: 'auto' }} />
7171

72-
<br/>
73-
7472
This update removes LiteLLM router inefficiencies, reducing complexity from O(M×N) to O(1). Previously, it built a new array and ran repeated checks like data["model"] in llm_router.get_model_ids(). Now, a direct ID-to-deployment map eliminates redundant allocations and scans.
7573

7674
As a result, performance improved across all latency percentiles:

0 commit comments

Comments
 (0)