BasicVSR++: reproduce ntire decompression results.

[kai422]

Thanks for your great work!
I try to reproduce results of ntire track-3 with provided pretrained weight.
I filled lq_folder with NTIRE21_validation_fixed-rate and gt_folder with NTIRE21_validation__raw,
Use basicvsr_plusplus_c128n25_ntire_decompress_track3_20210304-6daf4a40.pth , the final testing PSNR for the validation set is 28.67.
The testing script I used is

python tools/test.py configs/restorers/basicvsr_plusplus/basicvsr_plusplus_c128n25_600k_ntire_decompress_track3.py weights/basicvsr_plusplus_c128n25_ntire_decompress_track3_20210304-6daf4a40.pth

I wonder :

1. if it's possible for you to provide the results for ntire track3 validation set?
2. How could I achieve PSNR result to the same level with the result 30.37 of the test set which is reported in the ntire workshop paper?

Are there any other steps I need to follow?
Thanks!

[ckkelvinchan]

30.37 is the PSNR on the test set, which is not the same as the validation set. Only the organizer has the GT of the test set.

This model is the model we used for the competition.

[kai422]

May I check for the test set, do I need to specify additional parameters in the testing pipeline for ensemble (×8) testing? (including Flip and Rotation). Thanks!

[ckkelvinchan]

May I check for the test set, do I need to specify additional parameters in the testing pipeline for ensemble (×8) testing? (including Flip and Rotation). Thanks!

So far we did not implement it. You can modify the basicvsr.py for the ensemble. I will add support to it later. Thank you very much for letting us know your need :)

[kai422]

Thank you!

[kai422]

For the validation set, the PSNR for unprocessed video is 27.09, the 28.67(+1.58) from basicvsr++ is of the same improvement level as the test set. (no ensemble testing)

In the nitire report, for the test set, the unprocessed video PSNR is 28.34 compared to 30.37(+2.03) of basicvsr++. (8x ensemble testing).

Thanks for your help!

[Kadakol]

Hi @kai422 and @ckkelvinchan ,

Can I ask how to get access to the validation raw data? The NTIRE challenge only seems to be providing the compressed data for validation. Am I missing something here? Please suggest.

[kai422]

Hi @kai422 and @ckkelvinchan ,

Can I ask how to get access to the validation raw data? The NTIRE challenge only seems to be providing the compressed data for validation. Am I missing something here? Please suggest.

Please check this: https://github.com/RenYang-home/NTIRE21_VEnh

[Kadakol]

Thank you so much @kai422 !