Commit 8d6cf89
[V1] [Spec Decode] Support random sampling for spec decode (#13933)
Co-authored-by: Woosuk Kwon <[email protected]>1 parent 583a977 commit 8d6cf89
File tree
5 files changed
+572
-198
lines changed- tests/v1/sample
- vllm/v1
- sample
- spec_decode
- worker
5 files changed
+572
-198
lines changed
0 commit comments