StochasticWeightAveraging, validation and checkpoints

[stas-sl]

Hi!

I'm a bit struggling to understand how StochasticWeightAveraging works. I have the following questions:

1. What weights are used during validation stage - averaged or current?
2. If I save checkpoints based on validation score, what weights are saved - average or current?

Thanks!