FP16 Forward Support on Hopper GPUs?

[handcomechan-1997]

Hi,

I noticed that FP16 forward operations don’t seem to work on Hopper GPUs. Could you confirm if this is correct? Also, are there plans to support this in the future?

Thanks!

[zzd1992]

Currently, I can't access Hopper GPUs (I only test it on RTX4090).
But I think FP16 is supported by Hopper GPUs. Can you share your test script and error trace?