[Training Log 2022-10-17] We temporarily remove two datasets and are fixing an issue with the data loader.

[zh-zheng]

CPM-Live Training Log (October, 17)

Time: October, 17 2022 19:00

Recorder: @zh-zheng

Loss

• Begin: 2.71
• End: 2.59

Completed Data

• $\approx$ 1,276.51GB

Average Grad Norm

• 1.77

Progress

• 3.1%

Comment

Key events:

• 2022/10/16 19:30: Since the recent training is not very stable, we temporarily remove the title generation and summarization datasets.

• 2022/10/16 21:55: We encounter an issue with the data loader. The training has temporarily stopped, and we are fixing this problem.