Training Log 2022-07-09

[zh-zheng]

CPM-Live Training Log (July, 9)

Time: July, 9 2022 16:00

Recorder: @jayzzhou-thu

Loss

• Begin: 2.55
• End: 2.60

Completed Data

• $\approx$ 518.54GB

Average Grad Norm

• 0.92

Progress

• 55.68%

Comment

The change in the training loss is currently in line with our expectations. A new model NLLB is recently released by Meta. The model is multi-lingual and could translate between 200 languages. It is so cool and we wish CPM-Live could support more languages in the future.