Skip to content

Commit

Permalink
Update layers.py (metavoiceio#47)
Browse files Browse the repository at this point in the history
Signed-off-by: sifat <hossain0338@gmail.com>
  • Loading branch information
shhossain authored Feb 13, 2024
1 parent 43f97a0 commit d10f365
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion fam/llm/layers/layers.py
Original file line number Diff line number Diff line change
Expand Up @@ -17,7 +17,7 @@ def forward(self, input):
return F.layer_norm(input, self.weight.shape, self.weight, self.bias, 1e-5)


class RMSNorm(torch.nn.Module):
class RMSNorm(nn.Module):
def __init__(self, ndim: int, eps: float):
super().__init__()
self.eps = eps
Expand Down

0 comments on commit d10f365

Please sign in to comment.