Numerical issues when comparing the results of qk_sparse_attention and F.scaled_dot_product_attention

[ThisisBillhe]

Hi! Thanks for your great work! I notice that there can be some numerical issues in your implementation, like this:


Any idea how this will happen and how to avoid this?