XFormers for Cuda 12.8?

[Dudekpob]

Hello I would like to ask if there is any version of xformers compatible with cuda 12.8 and torch>=2.7.0
Thank you have a nice day

[312391947]

Xformers for Cuda 12.8

[bjranson]

Yes, this is needed. It's a roadblock for anyone with a Blackwell (50xx) series nVidia card right now. And trying to build your own is an absolutely brutal process. Need some help from the experts here, please.

[TomaKatzarov]

I am in the same boat. This is very needed. Any update will be welcomed!

[echoedexistence]

i just bought my blackwell (50xx) series and is stuck with this, have to spend an extra 2-3 days to do training as i have to disable xformers off.. please anyone with a solution

[AlexChesser]

if you've doing blackwell you could probably try my devcontainer you should be able to just check out and go https://github.com/AlexChesser/xformers-devcontainer

I just got it working on my machine - so I'd love to hear if it is stable on someone else's

I'm building for 50xx architecture and cu128 and the latest pytorch stuff (I'm actually 2.8 IIRC, I didn't do 2.9.

OH! and I suppose if you don't want a devcontainer and just want the wheels you could pull from alexchesser/xformers-builder and copy the compiled wheels

COPY --from=alexchesser/xformers-builder /opt/xformers-wheels /opt/xformers-wheels