Skip to content

Commit 17ca484

Browse files
rootcqulilujia
authored andcommitted
Fix the typos of FusedRMSNorm doc
1 parent 73375b3 commit 17ca484

File tree

1 file changed

+1
-2
lines changed

1 file changed

+1
-2
lines changed

apex/normalization/fused_layer_norm.py

Lines changed: 1 addition & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -745,8 +745,7 @@ class FusedLayerNorm(torch.nn.Module):
745745
normalize over the last dimension which is expected to be of that specific size.
746746
eps: a value added to the denominator for numerical stability. Default: 1e-5
747747
elementwise_affine: a boolean value that when set to ``True``, this module
748-
has learnable per-element affine parameters initialized to ones (for weights)
749-
and zeros (for biases). Default: ``True``.
748+
has learnable per-element affine parameters initialized to ones for weights. Default: ``True``.
750749
751750
Shape:
752751
- Input: :math:`(N, *)`

0 commit comments

Comments
 (0)