You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
# Distillation with Llama 4 and Synthetic Data Kit
2
+
3
+
*Copyright (c) Meta Platforms, Inc. and affiliates.*
4
+
This software may be used and distributed according to the terms of the Llama Community License Agreement.*
5
+
6
+
<ahref="https://colab.research.google.com/github/meta-llama/llama-cookbook/blob/main/getting-started/finetuning/quickstart_peft_finetuning.ipynb"target="_parent"><imgsrc="https://colab.research.google.com/assets/colab-badge.svg"alt="Open In Colab"/></a>
7
+
8
+
This notebook will walk you through distilling model knowledge from Llama 4 into a smaller Llama 3.2 model using synthetic training data from Synthetic Data Kit.
0 commit comments