[Question] How many iterations for the available pretrained model?

[shivammehta25]

Hello!

Thank you for the amazing work and making the code available :D

I am training the model from scratch and was just curious about how many iterations and at what batch size I should run it to obtain a comparable quality to the pretrained model provided in this repository?

[haoweilou]

According to the paper, the model was trained for 270k steps with a batch size of 32.