4090?

[SSCBryce]

The big question. Anyone have any idea when we can expect things to get better for us 4090 enjoyers? And does anyone have any ideas for ways to improve performance in the meantime? I'm all ears in particular.

[TingTingin]

what do you mean is there an issue with the 4090?

[SSCBryce]

Not an issue per se, just poor performance. People elsewhere said something about PyTorch needing to be forked or something, so it's not just me. But I'm also not trying to say that something needs to be done, I just don't know what changes I'd need to make anyway if I can.

[Kosinkadink]

I have a 4090 as well, and with the default pytorch being pulled, I am getting only 66% of the performance of a 3090 (I didn't have xformers enabled when benchmarking the 3090, so with xformers the performance deficit is even greater). From my understanding, CUDA 11.8 is the first official release that supports the Lovelace architecture, so until a pytorch wheel is available that's been built against it, we would need to build pytorch and likely xformers ourselves to get the true performance. I haven't had the free time to attempt that yet, but when I do, I'll update with the performance numbers.

[SSCBryce]

Sounds right to me. Bonus points for any help in doing that myself as well, if it works out :D

[SSCBryce]

Hey again, I actually attempted to build them myself using the guide at , making obvious changes like using Cuda 11.8.

I got to the point of:
Build xformers python setup.py build
where then, I get (screenshot):

I'm thinking it's the part of the guide where it has you get , which again might not be the right version. Thing is, I have no idea which one it might be. Going to in a browser gives you a lot of options, but I'm not sure which ones are even for a GPU. Perhaps "cuda80" would work? Or maybe "torch_nightly"? But that one could be CPU only or something similar. Or I could be wrong and this isn't it at all :D. Any ideas?

[ClashSAN]

So, rumor has it that @C43H66N12O12S2 will be getting a 4090.. He brought you guys xformers (big thanks)