Skip to content

Commit b4e7dd9

Browse files
committed
update: simple_zero_rank_parameter
1 parent d274329 commit b4e7dd9

File tree

1 file changed

+6
-0
lines changed

1 file changed

+6
-0
lines changed

tests/utils.py

Lines changed: 6 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -44,6 +44,12 @@ def forward(self, x: torch.Tensor) -> torch.Tensor:
4444
return self.norm1(self.fc1(x))
4545

4646

47+
def simple_zero_rank_parameter(require_grad: bool = True) -> torch.Tensor:
48+
param = torch.tensor(0.0).requires_grad_(require_grad)
49+
param.grad = torch.tensor(0.0)
50+
return param
51+
52+
4753
def simple_parameter(require_grad: bool = True) -> torch.Tensor:
4854
param = torch.zeros(1, 1).requires_grad_(require_grad)
4955
param.grad = torch.zeros(1, 1)

0 commit comments

Comments
 (0)