[checkpoints] replace bf16 with fp32 checkpoint weights#327

stas00 wants to merge 3 commits intomainbigscience-workshop/Megatron-DeepSpeed:mainfrom

universal_to_fp32_checkpointbigscience-workshop/Megatron-DeepSpeed:universal_to_fp32_checkpointCopy head branch name to clipboard