[skip ci] docs: comment about possible memory leak

kozistr · kozistr · commit 7588ee2a7431 · 2021-09-22T16:50:25.000+09:00
diff --git a/pytorch_optimizer/adahessian.py b/pytorch_optimizer/adahessian.py
@@ -147,6 +147,7 @@ def set_hessian(self):
                 - 1.0
                 for p in params
             ]
+            # note that, possible memory leak due to retrain_graph=True
             h_zs = torch.autograd.grad(
                 grads,
                 params,

Original file line number	Diff line number	Diff line change
`@@ -147,6 +147,7 @@ def set_hessian(self):`
`147`	`147`	`- 1.0`
`148`	`148`	`for p in params`
`149`	`149`	`]`
	`150`	`+ # note that, possible memory leak due to retrain_graph=True`
`150`	`151`	`h_zs = torch.autograd.grad(`
`151`	`152`	`grads,`
`152`	`153`	`params,`