Skip to content

Commit 56ef97e

Browse files
[#10246][feature] Move AD dashboard to use cudagraph compile backend (#10267)
Signed-off-by: Tal Cherckez <[email protected]>
1 parent ecea71c commit 56ef97e

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

examples/auto_deploy/model_registry/configs/dashboard_default.yaml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -3,7 +3,7 @@
33

44
runtime: trtllm
55
attn_backend: flashinfer
6-
compile_backend: torch-compile
6+
compile_backend: torch-cudagraph
77
model_factory: AutoModelForCausalLM
88
skip_loading_weights: false
99
max_seq_len: 512

0 commit comments

Comments
 (0)