[Training Log 2022-08-06] The first day of CPM-Ant+!

[zh-zheng]

CPM-Live Training Log (August, 6)

Time: August, 6 2022 16:00

Recorder: @zh-zheng

Loss

• Begin: 2.37
• End: 2.27

Completed Data

• $\approx$ 944.67GB

Average Grad Norm

• 0.52

Progress

• 101.43%

Comment

The first day to update the log of CPM-Ant+! We reduced the computing resources from 32 to 8 A100 GPUs. Furthermore, we migrated the training data to a newly implemented distributed dataset, which is more flexible and robust.