Why setting step_up_ratio=0.0?

[wuyongfa-genius]

I just wonder woud it be better to have some iterations during which the learning rate goes up.

[hyz-xmaster]

Hi, quoting the original SWA paper:

We propose to use a discontinuous schedule that jumps directly from the minimum to maximum learning rates, and does not steadily increase the learning rate as part of the cycle. We use this more abrupt cycle because for our purposes exploration is more important than the accuracy of individual proposals.

We did not try your idea and thus cannot answer your question. It is welcome that you provide some results on this.