Currently only the final models are saved. but to refit the weights with the newest data will require all the old iterations.