Possible to retrieve effective LR?

[maxxrox]

Given an LR of x, the effective LR employed by the optimizer is f(x); is it possible to retrieve that effective LR programatically?

Specifically, is it possible to get this dumped into TensorBoard?

As I see it, regardless of optimizer or LR scalar, the LR reported is only what is scheduled, not what's being utilized.

[O-J1]

Given an LR of x, the effective LR employed by the optimizer is f(x); is it possible to retrieve that effective LR programatically?

Specifically, is it possible to get this dumped into TensorBoard?

As I see it, regardless of optimizer or LR scalar, the LR reported is only what is scheduled, not what's being utilized.

Please submit a feature request in issues, this is a discussion board