Training Log 2022-06-08

[zh-zheng]

CPM-Live Training Log (June, 8)

Time: June, 8 2022 16:00

Recorder: @zh-zheng

Loss

• Begin: 2.79
• End: 2.98

Completed Data

• $\approx$ 56.20GB

Average Grad Norm

• 0.74

Progress

• 6.03%

Comment

Due to computing center maintenance, we suspended the training for around 17 hours yesterday. Then we have resumed the training on a cluster with 32 A100 GPUs. The throughput is quadrupled now!