File tree Expand file tree Collapse file tree 1 file changed +3
-3
lines changed
Expand file tree Collapse file tree 1 file changed +3
-3
lines changed Original file line number Diff line number Diff line change 44
55** Differentiated KV Cache Quantization for Apple Silicon**
66
7- [ ![ GitHub Stars] ( https://img.shields.io/github/stars/dipampaul17/kvsplit ?style=for-the-badge&logo=github )] ( https://github.com/dipampaul17/kvsplit /stargazers )
8- [ ![ License] ( https://img.shields.io/github/license/dipampaul17/kvsplit ?style=for-the-badge )] ( LICENSE )
7+ [ ![ GitHub Stars] ( https://img.shields.io/github/stars/dipampaul17/KVSplit ?style=for-the-badge&logo=github )] ( https://github.com/dipampaul17/KVSplit /stargazers )
8+ [ ![ License] ( https://img.shields.io/github/license/dipampaul17/KVSplit ?style=for-the-badge )] ( LICENSE )
99[ ![ Platform] ( https://img.shields.io/badge/Platform-Apple%20Silicon-black?style=for-the-badge&logo=apple )] ( )
1010
1111<img src =" ./plots/kv_cache_memory_usage.png " alt =" KV Cache Memory Usage " width =" 70% " >
@@ -60,7 +60,7 @@ Run **larger context windows** and **heavier LLMs** on your Mac by applying diff
6060
6161``` bash
6262# Clone the repository
63- git clone https://github.com/dipampaul17/kvsplit .git
63+ git clone https://github.com/dipampaul17/KVSplit .git
6464cd kvsplit
6565
6666# Run the installer script
You can’t perform that action at this time.
0 commit comments