Saved model checkpoint in different precision ?

[Ankush2k]

Hi Team,
Great work!!
I would like to know the precision in which the model checkpoint is saved.
For example, if trained with bf16 precision, what will the checkpoint precision will be?

Thanks

[Ankush2k]

Hi Team,
above doubt have been resolved - Model weights dtype will be bf16.
Another doubt,
Is there any specific setting/argument that we need so that the model checkpoint will be stored in fp32?

Thanks