Skip to content

Commit 34f67a8

Browse files
authored
add fuse_multi_transformer passes to fp16. test=develop (#47733)
1 parent b3e4571 commit 34f67a8

File tree

1 file changed

+6
-0
lines changed

1 file changed

+6
-0
lines changed

paddle/fluid/inference/api/paddle_pass_builder.cc

Lines changed: 6 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -163,6 +163,12 @@ const std::vector<std::string> kGpuLowerPrecisionPasses{
163163
"conv_elementwise_add2_act_fuse_pass",
164164
"conv_elementwise_add_fuse_pass",
165165
"multihead_matmul_fuse_pass_v2",
166+
"fused_multi_transformer_encoder_pass",
167+
"fused_multi_transformer_decoder_pass",
168+
"fused_multi_transformer_encoder_fuse_qkv_pass",
169+
"fused_multi_transformer_decoder_fuse_qkv_pass",
170+
"multi_devices_fused_multi_transformer_encoder_fuse_qkv_pass",
171+
"multi_devices_fused_multi_transformer_decoder_fuse_qkv_pass",
166172
"gpu_cpu_map_matmul_v2_to_mul_pass",
167173
"gpu_cpu_map_matmul_v2_to_matmul_pass",
168174
"fc_fuse_pass",

0 commit comments

Comments
 (0)