Flash Attention 2.8.3

[pftq]

I am getting this error with Flash Attention 2.8.3
Cannot import /workspace/ComfyUI/custom_nodes/ComfyUI-WanVideoWrapper module for custom nodes: Requires Flash-Attention version >=2.7.1,<=2.8.2 but got 2.8.3.

Is this a hard restriction or can we adjust a setting somewhere to allow 2.8.3?

[pftq]

Nevermind on this. For anyone else running into this problem, the solution is to go to your xformers installation and edit 2.8.2 to 2.8.3 on the line (~82) that does the version check for Flash Attention.

On Runpod in a venv, it was done by opening:
/workspace/ComfyUI/venv/lib/python3.11/site-packages/xformers/ops/fmha/flash.py

Then changing this line:
FLASH_VER_LAST = parse_version("2.8.3")

[pftq]

@kijai I ran into an additional error - "TypeError: only integer tensors of a single element can be converted to an index" - not sure if it's specific to the flash-attn 2.8.3 I'm using or the B200 GPU.

This seems to fix the error if you want to incorporate it:
#1318

I don't know if this breaks it on other setups though - I didn't test on other GPUs or flash-attn versions.