Skip to content

Commit e709732

Browse files
authored
Update T5TritonModel.cc
fix bug of T5TritonModel
1 parent d83204b commit e709732

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

src/fastertransformer/triton_backend/t5/T5TritonModel.cc

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -190,7 +190,7 @@ T5TritonModel<T>::createModelInstance(int
190190
ft::getAttentionType<T>(encoder_size_per_head_, sm_, true, encoder_num_bucket_or_max_pos_seq_len_, false);
191191

192192
ft::NcclParam tensor_para_ = nccl_params.first[comms_rank];
193-
ft::NcclParam pipeline_para_ = nccl_params.first[comms_rank];
193+
ft::NcclParam pipeline_para_ = nccl_params.second[comms_rank];
194194

195195
auto encoder = std::make_unique<ft::T5Encoder<T>>(ft::T5Encoder<T>(0,
196196
0,

0 commit comments

Comments
 (0)