I train my custom dataset with YOLOP with tesla V100, I found that it training speed is very fast in first but it will get slow after 40 times. May I ask if this is normal or I ignore some settings? Thanks for any suggestions.

Epoch: [5][0/808] Time 7.420s (7.420s) Speed 6.5 samples/s Data 5.233s (5.233s) Loss 0.40308 (0.40308)
Epoch: [5][20/808] Time 113.373s (60.213s) Speed 0.4 samples/s Data 111.287s (58.143s) Loss 0.43158 (0.41728)
Epoch: [5][40/808] Time 226.024s (115.841s) Speed 0.2 samples/s Data 223.994s (113.749s) Loss 0.43076 (0.41315)
Epoch: [5][60/808] Time 334.304s (170.884s) Speed 0.1 samples/s Data 332.240s (168.793s) Loss 0.39735 (0.41089)
Epoch: [5][80/808] Time 448.564s (226.228s) Speed 0.1 samples/s Data 446.482s (224.125s) Loss 0.40302 (0.40986)
Epoch: [5][100/808] Time 561.691s (281.968s) Speed 0.1 samples/s Data 559.411s (279.865s) Loss 0.39656 (0.40988)