We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
1 parent 9224a28 commit d99b493Copy full SHA for d99b493
blog/2024-12-04-sglang-v0-4.md
@@ -5,7 +5,7 @@ date: "December 3, 2024"
5
previewImg: /images/blog/sglang_v0_4/nsys_no_idle.jpg
6
---
7
8
-We’re excited to release SGLang v0.4, featuring significant performance improvements and new features:
+We’re excited to release [SGLang v0.4](https://github.com/sgl-project/sglang), featuring significant performance improvements and new features:
9
10
- Zero-overhead batch scheduler: 1.1x increase in throughput.
11
- Cache-aware load balancer: up to 1.9x increase in throughput with 3.8x higher cache hit rate.
0 commit comments