Skip to content

Commit 448d79c

Browse files
h-guo18yeyu-nvidia
andcommitted
address comments
Co-authored-by: yeyu-nvidia <[email protected]> Signed-off-by: h-guo18 <[email protected]>
1 parent 8ec52e5 commit 448d79c

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

examples/speculative_decoding/example.ipynb

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -22,7 +22,7 @@
2222
"metadata": {},
2323
"source": [
2424
"## Convert Model for Speculative Decoding\n",
25-
"Here, we'll adapt our base model for speculative decoding by attaching a smaller EAGLE Head. The upcoming code first loads meta-llama/Llama-3.2-1B as our base model and then configures the new draft head. To ensure compatibility, the draft head's dimensions must match the target model. Finally, the modelopt toolkit attaches this new, untrained head, leaving us with a combined model that is ready for the training phase later."
25+
"Here, we'll adapt our base model for speculative decoding by attaching a smaller EAGLE module. The upcoming code first loads meta-llama/Llama-3.2-1B as our base model and then configures the new draft module. To ensure compatibility, the draft module's dimensions must match the target model. Finally, the modelopt toolkit attaches this new, untrained module, leaving us with a combined model that is ready for the training phase later."
2626
]
2727
},
2828
{

0 commit comments

Comments
 (0)