Skip to content

Commit be8921f

Browse files
authored
Change size of single CUDA graph for CI to 4 (vllm-project#26089)
Signed-off-by: Thomas Parnell <[email protected]>
1 parent d4e7a11 commit be8921f

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

tests/conftest.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -732,7 +732,7 @@ def __init__(
732732
set_default_torch_num_threads(default_torch_num_threads))
733733

734734
if not kwargs.get("compilation_config", None):
735-
kwargs["compilation_config"] = {"cudagraph_capture_sizes": [8]}
735+
kwargs["compilation_config"] = {"cudagraph_capture_sizes": [4]}
736736

737737
with init_ctx:
738738
self.llm = LLM(

0 commit comments

Comments
 (0)