Skip to content

Commit 7c2749a

Browse files
authored
[misc] add start loading models for users information (#6670)
1 parent 729171a commit 7c2749a

File tree

1 file changed

+1
-0
lines changed

1 file changed

+1
-0
lines changed

vllm/worker/model_runner.py

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -677,6 +677,7 @@ def __init__(
677677
int(self.cache_config.cpu_offload_gb * 1024**3))
678678

679679
def load_model(self) -> None:
680+
logger.info("Starting to load model %s...", self.model_config.model)
680681
with CudaMemoryProfiler() as m:
681682
self.model = get_model(model_config=self.model_config,
682683
device_config=self.device_config,

0 commit comments

Comments
 (0)