Skip to content

Commit b0f3021

Browse files
authored
Update README.md
1 parent ca6c61d commit b0f3021

File tree

1 file changed

+2
-2
lines changed

1 file changed

+2
-2
lines changed

README.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,6 @@
11
# Training-Free Acivation Sparsity in Large Language Models
22

3-
[[Paper](https://www.arxiv.org/abs/2408.14690)][[Blog](XXX)]
3+
[[Paper](https://www.arxiv.org/abs/2408.14690)][[Blog]([XXX](https://www.together.ai/blog/teal-training-free-activation-sparsity-in-large-language-models))]
44

55

66
TEAL induces up to 40-50% model-wide activation sparsity in modern LLMs with minimal degradation, resulting in an up to 1.53-1.8x speedup in single-batch decoding.
@@ -132,4 +132,4 @@ CUDA_VISIBLE_DEVICES=0 python teal/ppl_test.py \
132132
--model_name meta-llama/Llama-2-7b-hf \
133133
--teal_path $OUTPUT_PATH$ \
134134
--sparsity 0.5
135-
```
135+
```

0 commit comments

Comments
 (0)