[Training Log 2022-07-08] The loss is back to 'normal'.

[zh-zheng]

CPM-Live Training Log (July, 8)

Time: July, 8 2022 16:00

Recorder: @zh-zheng

Loss

• Begin: 2.37
• End: 2.55

Completed Data

• $\approx$ 502.95GB

Average Grad Norm

• 0.88

Progress

• 54.00%

Comment

Once again the loss has gone up! That's an interesting but probably reasonable result if you have seen our log for this day. That is to say, after learning from the data that has been seen many times, the loss of our model will return to the level it should be at.