Skip to content

Commit fb4ac25

Browse files
authored
Fix typo in LayerNorm (#285)
Co-authored-by: Artem Lukin <[email protected]>
1 parent 53fe345 commit fb4ac25

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

vit_pytorch/vit_1d.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -10,7 +10,7 @@ class FeedForward(nn.Module):
1010
def __init__(self, dim, hidden_dim, dropout = 0.):
1111
super().__init__()
1212
self.net = nn.Sequential(
13-
nn.Layernorm(dim),
13+
nn.LayerNorm(dim),
1414
nn.Linear(dim, hidden_dim),
1515
nn.GELU(),
1616
nn.Dropout(dropout),

0 commit comments

Comments
 (0)