Skip to content

Commit 1547b28

Browse files
ksuma2109Suma Kasa
andcommitted
Update vLLM to version 0.11.1 (#2956)
Co-authored-by: Suma Kasa <sumakasa@amazon.com>
1 parent 6eb76e7 commit 1547b28

File tree

2 files changed

+2
-1
lines changed

2 files changed

+2
-1
lines changed

serving/docker/lmi-container-requirements.txt

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -32,7 +32,7 @@ uvloop
3232
ninja
3333
peft
3434
llmcompressor
35-
https://vllm-wheels.s3.us-west-2.amazonaws.com/93103575ce0480f36fc1a3603eb51d9a89f38a00/vllm-1.0.0.dev-cp38-abi3-manylinux1_x86_64.whl
35+
vllm==0.11.1
3636
xgrammar
3737
flashinfer-python==0.5.2
3838
lmcache

tests/integration/llm/prepare.py

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -162,6 +162,7 @@
162162
'{"method":"eagle","model":"yuhuili/EAGLE-LLaMA3.1-Instruct-8B","num_speculative_tokens":4}',
163163
"option.tensor_parallel_degree": 4,
164164
"option.max_rolling_batch_size": 4,
165+
"option.enforce_eager": True,
165166
},
166167
"llama-7b-unmerged-lora": {
167168
"option.model_id": "s3://djl-llm/huggyllama-llama-7b",

0 commit comments

Comments
 (0)