File tree Expand file tree Collapse file tree 1 file changed +13
-7
lines changed Expand file tree Collapse file tree 1 file changed +13
-7
lines changed Original file line number Diff line number Diff line change @@ -27,18 +27,24 @@ Simple Usage
2727
2828::
2929
30- from pytorch_optimizer import Ranger21
30+ from pytorch_optimizer import AdamP
3131
3232 ...
3333 model = YourModel()
34- optimizer = Ranger21 (model.parameters())
34+ optimizer = AdamP (model.parameters())
3535 ...
3636
37- for input, output in data:
38- optimizer.zero_grad()
39- loss = loss_function(output, model(input))
40- loss.backward()
41- optimizer.step()
37+ or you can use optimizer loader, simply passing a name of the optimizer.
38+
39+ ::
40+
41+ from pytorch_optimizer import load_optimizers
42+
43+ ...
44+ model = YourModel()
45+ opt = load_optimizers(optimizer='adamp', use_fp16=True)
46+ optimizer = opt(model.parameters())
47+ ...
4248
4349Supported Optimizers
4450--------------------
You can’t perform that action at this time.
0 commit comments