Skip to content

Commit 89ec06c

Browse files
authored
[Docs] [Spec decode] Fix docs error in code example (#5427)
1 parent 9fde251 commit 89ec06c

File tree

1 file changed

+2
-0
lines changed

1 file changed

+2
-0
lines changed

docs/source/models/spec_decode.rst

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -17,6 +17,7 @@ Speculating with a draft model
1717
The following code configures vLLM to use speculative decoding with a draft model, speculating 5 tokens at a time.
1818

1919
.. code-block:: python
20+
2021
from vllm import LLM, SamplingParams
2122
2223
prompts = [
@@ -45,6 +46,7 @@ The following code configures vLLM to use speculative decoding where proposals a
4546
matching n-grams in the prompt. For more information read `this thread. <https://x.com/joao_gante/status/1747322413006643259>`_
4647

4748
.. code-block:: python
49+
4850
from vllm import LLM, SamplingParams
4951
5052
prompts = [

0 commit comments

Comments
 (0)