Skip to content

Commit 362484b

Browse files
authored
[0.34.0-dlc] CVE patching and use official vLLM wheel (#2911)
1 parent 514ea62 commit 362484b

File tree

2 files changed

+5
-6
lines changed

2 files changed

+5
-6
lines changed

serving/docker/lmi-container-requirements.txt

Lines changed: 4 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -1,7 +1,7 @@
11
torch==2.8.0
22
torchvision
33
peft==0.15.1
4-
protobuf==3.20.3
4+
protobuf==4.25.1
55
transformers==4.55.2
66
hf-transfer
77
zstandard
@@ -20,7 +20,7 @@ retrying
2020
opencv-contrib-python-headless
2121
safetensors
2222
scipy==1.16.0
23-
onnx==1.16.0
23+
onnx==1.19.0
2424
sentence_transformers
2525
onnxruntime-gpu==1.20.0
2626
autoawq
@@ -31,6 +31,6 @@ uvloop
3131
ninja
3232
peft
3333
llmcompressor
34-
https://publish.djl.ai/sm-vllm/vllm-0.10.2-cp38-abi3-linux_x86_64.whl
35-
xgrammar==0.1.23
34+
vllm==0.10.2
35+
xgrammar
3636
flashinfer-python==0.2.5

serving/docker/lmi.Dockerfile

Lines changed: 1 addition & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -89,8 +89,7 @@ RUN scripts/patch_oss_dlc.sh python \
8989
&& apt-get clean -y && rm -rf /var/lib/apt/lists/*
9090

9191
COPY lmi-container-requirements.txt ./requirements.txt
92-
RUN pip3 install torch==2.6.0 torchvision \
93-
&& pip3 install flashinfer-python -i https://flashinfer.ai/whl/cu126/torch2.6/ \
92+
RUN pip3 install torch==2.8.0 torchvision \
9493
&& pip3 install -r requirements.txt \
9594
&& pip3 install ${djl_converter_wheel} --no-deps
9695

0 commit comments

Comments
 (0)