Skip to content

Commit 6c805b9

Browse files
committed
Force gc.collect to work around regression caused by vllm-project#21146
1 parent 5d03d9d commit 6c805b9

File tree

1 file changed

+1
-0
lines changed

1 file changed

+1
-0
lines changed

vllm/v1/worker/gpu_model_runner.py

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -2637,6 +2637,7 @@ def freeze_gc():
26372637
finally:
26382638
if should_freeze:
26392639
gc.unfreeze()
2640+
gc.collect()
26402641

26412642
# Trigger CUDA graph capture for specific shapes.
26422643
# Capture the large shapes first so that the smaller shapes

0 commit comments

Comments
 (0)