Skip to content

Commit a523f1d

Browse files
authored
🔥🔥[KVDirect] KVDirect: Distributed Disaggregated LLM Inference (#115)
1 parent 301cc21 commit a523f1d

File tree

1 file changed

+2
-1
lines changed

1 file changed

+2
-1
lines changed

README.md

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -98,7 +98,8 @@ Awesome-LLM-Inference: A curated list of [📙Awesome LLM Inference Papers with
9898

9999
|Date|Title|Paper|Code|Recom|
100100
|:---:|:---:|:---:|:---:|:---:|
101-
|2024.01|🔥🔥[DistServe] DistServe: Disaggregating Prefill and Decoding for Goodput-optimized Large Language Model Serving(@PKU)|[[pdf]](https://arxiv.org/pdf/2401.09670)|[[DistServe]](https://github.com/LLMServe/DistServe) ![](https://img.shields.io/github/stars/LLMServe/DistServe.svg?style=social) |⭐️⭐️ |
101+
|2024.01|🔥🔥[**DistServe**] DistServe: Disaggregating Prefill and Decoding for Goodput-optimized Large Language Model Serving(@PKU)|[[pdf]](https://arxiv.org/pdf/2401.09670)|[[DistServe]](https://github.com/LLMServe/DistServe) ![](https://img.shields.io/github/stars/LLMServe/DistServe.svg?style=social) |⭐️⭐️ |
102+
|2024.12|🔥🔥[**KVDirect**] KVDirect: Distributed Disaggregated LLM Inference(@ByteDance)|[[pdf]](https://arxiv.org/pdf/2501.14743)|⚠️|⭐️ |
102103

103104
### 📖LLM Algorithmic/Eval Survey ([©️back👆🏻](#paperlist))
104105
<div id="LLM-Algorithmic-Eval-Survey"></div>

0 commit comments

Comments
 (0)