Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
26 commits
Select commit Hold shift + click to select a range
3e53bb8
refactor_multi_step_attn_mask_for_arbitrary_step
yeyu-nvidia Sep 19, 2025
0b531c4
minor
yeyu-nvidia Sep 19, 2025
a123371
make new mask the same dtype and device as attn_mask
yeyu-nvidia Sep 19, 2025
c5a2e36
minor
yeyu-nvidia Sep 22, 2025
c6731f8
revert
yeyu-nvidia Sep 22, 2025
8aa0e12
integrate parallel draft to eagle auto regression
yeyu-nvidia Sep 23, 2025
ff04f43
debug
yeyu-nvidia Sep 23, 2025
e5f2403
fix pseudo spec generate for parallel draft
yeyu-nvidia Sep 23, 2025
e032a52
implement kv cache (inference_context) for eagle training
yeyu-nvidia Sep 24, 2025
5328b55
allow groundtruth mismatch in AcceptanceRateValidation
yeyu-nvidia Sep 25, 2025
be260f6
set fail_when_mismatch to False
yeyu-nvidia Sep 25, 2025
035d5ef
debug
yeyu-nvidia Sep 26, 2025
72b3aa0
debug
yeyu-nvidia Sep 26, 2025
460bc4e
debug
yeyu-nvidia Sep 26, 2025
72067dd
debug
yeyu-nvidia Sep 26, 2025
890a718
remove redundant index as now eagle_logits_ has a length of seq-len
yeyu-nvidia Sep 29, 2025
9195c18
minor edit based on coderabbit's suggestions
yeyu-nvidia Sep 29, 2025
32919ff
make ttt_step configurable in forward
yeyu-nvidia Oct 1, 2025
4abfb52
fix the bug in pseudo_speculative_generate
yeyu-nvidia Oct 1, 2025
cb9282e
change variable name to make it clear
yeyu-nvidia Oct 1, 2025
b47928e
debug: reduce kv cache size from ttt*parallel to ttt+parallel-1; in e…
yeyu-nvidia Oct 1, 2025
b528ccc
gitnore type for precommit
yeyu-nvidia Oct 1, 2025
44e0eb1
consolidate acc printout
yeyu-nvidia Oct 1, 2025
13f218c
fix the bug in pseudo_speculative_generate
yeyu-nvidia Oct 2, 2025
8212265
use embedding for mask tokens as hidden_states
yeyu-nvidia Oct 3, 2025
aa328ed
debug
yeyu-nvidia Oct 3, 2025
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Loading