You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: README.md
+2Lines changed: 2 additions & 0 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -269,6 +269,8 @@ Awesome-LLM-Inference: A curated list of [📙Awesome LLM Inference Papers with
269
269
|2024.06|🔥[LOOK-M] LOOK-M: Look-Once Optimization in KV Cache for Efficient Multimodal Long-Context Inference(@osu.edu etc)|[[pdf]](https://arxiv.org/pdf/2406.18139)|[[LOOK-M]](https://github.com/SUSTechBruce/LOOK-M)|⭐️⭐️ |
270
270
|2024.06|🔥🔥[**MInference**] MInference 1.0: Accelerating Pre-filling for Long-Context LLMs via Dynamic Sparse Attention(@Microsoft etc)|[[pdf]](https://arxiv.org/pdf/2407.02490)|[[MInference]](https://github.com/microsoft/MInference)|⭐️⭐️ |
271
271
|2024.06|🔥🔥[**InfiniGen**] InfiniGen: Efficient Generative Inference of Large Language Models with Dynamic KV Cache Management(@snu) |[[pdf]](https://arxiv.org/pdf/2406.19707)| ⚠️ |⭐️⭐️ |
0 commit comments