Skip to content

Commit 2ae8eec

Browse files
authored
Merge pull request kvcache-ai#697 from kvcache-ai/fix-yaml
Update DeepSeek-V3-Chat-multi-gpu-marlin.yaml
2 parents 8610a46 + 04c2fbc commit 2ae8eec

File tree

1 file changed

+2
-2
lines changed

1 file changed

+2
-2
lines changed

ktransformers/optimize/optimize_rules/DeepSeek-V3-Chat-multi-gpu-marlin.yaml

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -168,5 +168,5 @@
168168
replace:
169169
class: "default"
170170
kwargs:
171-
generate_device: "cuda:0"
172-
prefill_device: "cuda:0"
171+
generate_device: "cuda:1"
172+
prefill_device: "cuda:1"

0 commit comments

Comments
 (0)