Skip to content

Commit a3fdc0f

Browse files
add new log line
Signed-off-by: Diego-Castan <[email protected]>
1 parent 4e55e9d commit a3fdc0f

File tree

1 file changed

+2
-0
lines changed

1 file changed

+2
-0
lines changed

vllm/v1/worker/gpu_model_runner.py

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -2558,6 +2558,8 @@ def freeze_gc():
25582558
desc="Capturing CUDA graph shapes")
25592559
for num_tokens in compilation_cases:
25602560
# We skip EPLB here since we don't want to record dummy metrics
2561+
logger.info("DIEGO: compilation for number of tokens %d",
2562+
num_tokens)
25612563
for _ in range(
25622564
self.compilation_config.cudagraph_num_of_warmups):
25632565
self._dummy_run(num_tokens,

0 commit comments

Comments
 (0)