v2.6.2

What's Changed

• early exit of LLM inference by @boyi-liu in https://github.com/DefTruth/Awesome-LLM-Inference/pull/85
• Add paper AdaKV by @FFY0 in https://github.com/DefTruth/Awesome-LLM-Inference/pull/86
• Efficient Hybrid Inference for LLMs: Reward-Based Token Modelling with Selective Cloud Assistance by @aharshms in https://github.com/DefTruth/Awesome-LLM-Inference/pull/87
• 🔥[FastAttention] FastAttention: Extend FlashAttention2 to NPUs and Low-resource GPUs for Efficient Inference by @DefTruth in https://github.com/DefTruth/Awesome-LLM-Inference/pull/88

New Contributors

• @boyi-liu made their first contribution in https://github.com/DefTruth/Awesome-LLM-Inference/pull/85
• @FFY0 made their first contribution in https://github.com/DefTruth/Awesome-LLM-Inference/pull/86
• @aharshms made their first contribution in https://github.com/DefTruth/Awesome-LLM-Inference/pull/87

Full Changelog: DefTruth/Awesome-LLM-Inference@v2.6.1...v2.6.2