How to set TensorRT to support Flash Attention 3 #4561
Description
HI，
How does TensorRT control whether to load flash attention? I tried to install flash attention 3 (which includes the right swipe module hopper for H100) from the source code, but the FTT and throughput running on TensorRT on H100 before and after installation were basically the same, and it seems that I did not use the flash attention I installed. Please provide some ideas and suggestions, thank you very much.