[QUESTION] Does Megatron-LM supports P100?

[GaokaiZhang]

Does Megatron-LM supports P100? I heard that due to different hardware architecture it may not, but I haven't found direct evidence.

[deepakn94]

It should, though we haven't tested it on P100s in years, and a few bugfixes might be required,

[Edenzzzz]

Would be useful for a museum demo

[github-actions]

Marking as stale. No activity in 60 days.