v2.6.17

DefTruth released this 06 May 02:25

· 29 commits to main since this release

6d4ed04

What's Changed

🔥[BitNet v2] Native 4-bit Activations with Hadamard Transformation for 1-bit LLMs by @DefTruth in #144
Add The Sparse Frontier: Sparse Attention Trade-offs in Transformer LLMs by @PiotrNawrot in #145

New Contributors

@PiotrNawrot made their first contribution in #145

Full Changelog: v2.6.16...v2.6.17

Contributors

PiotrNawrot and DefTruth

Assets 2