Skip to content

Commit f46092b

Browse files
committed
fixed --model-path to --model
1 parent 9436a44 commit f46092b

File tree

1 file changed

+2
-2
lines changed

1 file changed

+2
-2
lines changed

examples/speculative_decoding/example.ipynb

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -335,7 +335,7 @@
335335
"source": [
336336
"#SGLang server launch command shell script\n",
337337
"sglang_serve_script = f\"\"\"python3 -m sglang.launch_server \\\\\n",
338-
" --model-path {base_model} \\\\\n",
338+
" --model {base_model} \\\\\n",
339339
" --host 0.0.0.0 \\\\\n",
340340
" --port 30000 \\\\\n",
341341
" --speculative-algorithm EAGLE3 \\\\\n",
@@ -440,7 +440,7 @@
440440
")\n",
441441
"output = response.json()\n",
442442
"\n",
443-
"print(output['choices'][0]['message']['content'])"
443+
"print(output)"
444444
]
445445
},
446446
{

0 commit comments

Comments
 (0)