Skip to content

Commit d0b6337

Browse files
authored
Pin to working config + stable release (#3885)
Signed-off-by: Seiji Eicher <[email protected]>
1 parent 8a31bfd commit d0b6337

File tree

1 file changed

+2
-7
lines changed

1 file changed

+2
-7
lines changed

ray-operator/config/samples/ray-service.deepseek.yaml

Lines changed: 2 additions & 7 deletions
Original file line numberDiff line numberDiff line change
@@ -27,7 +27,6 @@ spec:
2727
max_model_len: 16384
2828
enable_chunked_prefill: true
2929
enable_prefix_caching: true
30-
trust_remote_code: true
3130
import_path: ray.serve.llm:build_openai_app
3231
name: llm_app
3332
route_prefix: "/"
@@ -39,9 +38,7 @@ spec:
3938
spec:
4039
containers:
4140
- name: ray-head
42-
# TODO(seiji): change to Ray 2.48 when it's released
43-
# because https://github.com/ray-project/ray/pull/53815 is needed for DeepSeek
44-
image: rayproject/ray-llm:nightly-py311-cu128
41+
image: rayproject/ray-llm:2.46.0-py311-cu124
4542
resources:
4643
limits:
4744
cpu: "2"
@@ -68,9 +65,7 @@ spec:
6865
spec:
6966
containers:
7067
- name: ray-worker
71-
# TODO(seiji): change to Ray 2.48 when it's released
72-
# because https://github.com/ray-project/ray/pull/53815 is needed for DeepSeek
73-
image: rayproject/ray-llm:nightly-py311-cu128
68+
image: rayproject/ray-llm:2.46.0-py311-cu124
7469
resources:
7570
limits:
7671
cpu: "24"

0 commit comments

Comments
 (0)