Data Loading Logs

[fabianbosshard]

Hello Yuan

Thanks for the great work and for open-sourcing everything!

I have a quesiton about traintest_mask.py: Shouldn't end_time be updated after the evaluation? Because I think the way it is currently implemented leads to a very large number for per_sample_data_time direclty after the evaluation:

At first I thought it was because of cache or something similar, but I think it is because the evaluation time is also included in per_sample_data_time in the first iteration after the evaluation.

Best Regards,
Fabian

[YuanGongND]

hi Fabian,

Thanks for pointing out this, it might be a bug, but it does not impact the performance, right? I just use this to check I/O and network bottleneck.

-Yuan

[fabianbosshard]

Thank you for the quick response. No don't worry, it has no impact on performance, the variable is onnly used to check I/O bottleneck, as you said!