Skip to content

Commit 9bb0836

Browse files
JimHsiungliutongxuan
authored andcommitted
bugfix: add a check to prevent infinite loops in generate_random_decode_batch.
1 parent 5b23f52 commit 9bb0836

File tree

1 file changed

+1
-0
lines changed

1 file changed

+1
-0
lines changed

xllm/core/scheduler/profile/profile_manager.cpp

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -636,6 +636,7 @@ void ProfileManager::generate_random_decode_batch(
636636
std::vector<int32_t>& token_length_vec,
637637
std::vector<int32_t>& prefix_length_vec) {
638638
CHECK(total_length >= batch_size * min_context_len);
639+
CHECK(total_length <= batch_size * max_context_len);
639640

640641
token_length_vec.resize(batch_size, min_context_len);
641642
prefix_length_vec.resize(batch_size, min_context_len - 1);

0 commit comments

Comments
 (0)