Skip to content

Commit 9436a44

Browse files
committed
Updated haoguo's demo notebook with sglang instructions
1 parent b434545 commit 9436a44

File tree

1 file changed

+2
-2
lines changed

1 file changed

+2
-2
lines changed

examples/speculative_decoding/example.ipynb

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -286,7 +286,7 @@
286286
" \"model\": base_model,\n",
287287
" \"messages\": [\n",
288288
" {\"role\": \"system\", \"content\": \"You are a helpful assistant.\"},\n",
289-
" {\"role\": \"user\", \"content\": \"Hi, write me a story about a cat\"},\n",
289+
" {\"role\": \"user\", \"content\": \"Tell me about speculative decoding.\"},\n",
290290
" ],\n",
291291
" \"max_tokens\": 512,\n",
292292
" \"temperature\": 0,\n",
@@ -427,7 +427,7 @@
427427
" \"model\": base_model,\n",
428428
" \"messages\": [\n",
429429
" {\"role\": \"system\", \"content\": \"You are a helpful assistant.\"},\n",
430-
" {\"role\": \"user\", \"content\": \"Hi, write me a story about a cat\"},\n",
430+
" {\"role\": \"user\", \"content\": \"Tell me about speculative decoding.\"},\n",
431431
" ],\n",
432432
" \"max_tokens\": 512,\n",
433433
" \"temperature\": 0,\n",

0 commit comments

Comments
 (0)