Skip to content

Commit ab0d768

Browse files
authored
[None][fix] Fix attention dp log (NVIDIA#6570)
Signed-off-by: Shunkang <182541032+Shunkangz@users.noreply.github.co>
1 parent f7c13a4 commit ab0d768

File tree

1 file changed

+2
-1
lines changed

1 file changed

+2
-1
lines changed

tensorrt_llm/_torch/pyexecutor/py_executor.py

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -444,7 +444,8 @@ def profile_step():
444444
f"iter = {self.model_engine.iter_counter}, "
445445
f"global_rank = {self.global_rank}, "
446446
f"rank = {self.dist.rank}, "
447-
f"currank_total_requests = {self.num_fetch_requests_cur_rank}/{self.num_fetch_requests}, "
447+
f"currank_total_requests = {self.executor_request_queue.num_fetch_requests_cur_rank}/"
448+
f"{self.executor_request_queue.num_fetch_requests}, "
448449
f"elapsed_time = {end_time - start_time}s, "
449450
f"timestamp = {formatted_timestamp}, "
450451
f"num_scheduled_requests: {self.num_scheduled_requests}, "

0 commit comments

Comments
 (0)