File tree Expand file tree Collapse file tree 3 files changed +7
-6
lines changed Expand file tree Collapse file tree 3 files changed +7
-6
lines changed Original file line number Diff line number Diff line change 11r"""
22When doing Jacobian descent, the Jacobian matrix has to be aggregated into a vector to store in the
33``.grad`` fields of the model parameters. The
4- The :class:`~torchjd.aggregation._aggregator_bases.Aggregator` is responsible for these aggregations.
4+ The :class:`~torchjd.aggregation._aggregator_bases.Aggregator` is responsible for these
5+ aggregations.
56
67When using the :doc:`autogram <../autogram/index>` engine, we rather need to extract a vector
78of weights from the Gramian of the Jacobian. The
Original file line number Diff line number Diff line change 55
66class EdgeRegistry :
77 """
8- Tracks `GradientEdge`s and provides a way to efficiently compute a minimally sufficient subset of
9- leaf edges that are reachable from some given `GradientEdge`s.
8+ Tracks `GradientEdge`s and provides a way to efficiently compute a minimally sufficient subset
9+ of leaf edges that are reachable from some given `GradientEdge`s.
1010 """
1111
1212 def __init__ (self ) -> None :
Original file line number Diff line number Diff line change @@ -103,9 +103,9 @@ class JacobianAccumulator(torch.autograd.Function):
103103 """
104104 Autograd function that accumulates Jacobian Gramians during the first backward pass.
105105
106- Acts as identity on forward pass. During the autogram algorithm,
107- computes the Jacobian of outputs w.r.t. module parameters and feeds it to the gramian
108- accumulator. Uses a toggle mechanism to activate only during the Gramian accumulation phase.
106+ Acts as identity on forward pass. During the autogram algorithm, computes the Jacobian
107+ of outputs w.r.t. module parameters and feeds it to the gramian accumulator. Uses a
108+ toggle mechanism to activate only during the Gramian accumulation phase.
109109 """
110110
111111 @staticmethod
You can’t perform that action at this time.
0 commit comments