We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
1 parent 30d6466 commit d5dbdbfCopy full SHA for d5dbdbf
docs/design/debug_vllm_compile.md
@@ -9,7 +9,7 @@ TL;DR:
9
|----------|----------|-------------|
10
| --enforce-eager | enforce_eager=True | Turn off torch.compile and CUDAGraphs |
11
| -O.mode=0 | mode=CompilationMode.NONE | Turn off torch.compile only |
12
-| -O.cudagraph_mode=NONE | compilation_config=CompilationConfig(mode=CompilationMode.NONE) | Turn off CUDAGraphs only |
+| -O.cudagraph_mode=NONE | compilation_config=CompilationConfig(cudagraph_mode=CUDAGraphMode.NONE) | Turn off CUDAGraphs only |
13
| -O.backend=eager | compilation_config=CompilationConfig(backend='eager') | Turn off TorchInductor |
14
15
## vLLM-torch.compile overview
0 commit comments