Official code for the Manning book on structural LLM optimization: depth/width pruning, knowledge distillation, and attention optimization, runnable on free Colab GPUs.
-
Updated
Jun 23, 2026 - Jupyter Notebook
Official code for the Manning book on structural LLM optimization: depth/width pruning, knowledge distillation, and attention optimization, runnable on free Colab GPUs.
Research harness for evaluating query-time bounded elimination of reconstructable KV-cache witnesses in long-context transformer inference workloads. Related provisional filing: IN 202641062451.
Add a description, image, and links to the attention-optimization topic page so that developers can more easily learn about it.
To associate your repository with the attention-optimization topic, visit your repo's landing page and select "manage topics."