Thanks for sharing your code for us !
I have trained for more than 2500 epochs on one GTX 1080 ti, but the resolution is still the init phase :4X4 and doesn't grow . And I met the error after 2557 epochs like this:
AttributeError: 'DataParallel' object has no attribute 'grow_network'.
I don't know how to solve.