Skip to content

Commit f146f9a

Browse files
committed
feat: skip profile ttft when instance role is decode.
1 parent e686a10 commit f146f9a

File tree

1 file changed

+3
-1
lines changed

1 file changed

+3
-1
lines changed

xllm/core/scheduler/disagg_pd_scheduler.cpp

Lines changed: 3 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -77,7 +77,9 @@ DisaggPDScheduler::DisaggPDScheduler(Engine* engine, const Options& options)
7777
instance_info_.dp_size = options.dp_size();
7878

7979
// profile ttft and update instance info
80-
profile_ttft();
80+
if (options_.instance_role().value() != InstanceRole::DECODE) {
81+
profile_ttft();
82+
}
8183
}
8284

8385
DisaggPDScheduler::~DisaggPDScheduler() {

0 commit comments

Comments
 (0)