You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: python/paddle/nn/layer/norm.py
+6-6Lines changed: 6 additions & 6 deletions
Original file line number
Diff line number
Diff line change
@@ -652,7 +652,7 @@ class BatchNorm1D(_BatchNormBase):
652
652
r"""
653
653
Applies Batch Normalization over a 2D or 3D input (a mini-batch of 1D inputswith additional channel dimension) as described in the paper Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift .
654
654
655
-
When track_running_stats = False, the :math:`\\mu_{\\beta}`
655
+
When use_global_stats = False, the :math:`\\mu_{\\beta}`
656
656
and :math:`\\sigma_{\\beta}^{2}` are the statistics of one mini-batch.
657
657
Calculated as follows:
658
658
@@ -663,7 +663,7 @@ class BatchNorm1D(_BatchNormBase):
When track_running_stats = True, the :math:`\\mu_{\\beta}`
666
+
When use_global_stats = True, the :math:`\\mu_{\\beta}`
667
667
and :math:`\\sigma_{\\beta}^{2}` are not the statistics of one mini-batch.
668
668
They are global or running statistics (moving_mean and moving_variance). It usually got from the
669
669
pre-trained model. Calculated as follows:
@@ -743,7 +743,7 @@ class BatchNorm2D(_BatchNormBase):
743
743
r"""
744
744
Applies Batch Normalization over a 4D input (a mini-batch of 2D inputswith additional channel dimension) as described in the paper Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift .
745
745
746
-
When track_running_stats = False, the :math:`\\mu_{\\beta}`
746
+
When use_global_stats = False, the :math:`\\mu_{\\beta}`
747
747
and :math:`\\sigma_{\\beta}^{2}` are the statistics of one mini-batch.
748
748
Calculated as follows:
749
749
@@ -754,7 +754,7 @@ class BatchNorm2D(_BatchNormBase):
When track_running_stats = True, the :math:`\\mu_{\\beta}`
757
+
When use_global_stats = True, the :math:`\\mu_{\\beta}`
758
758
and :math:`\\sigma_{\\beta}^{2}` are not the statistics of one mini-batch.
759
759
They are global or running statistics (moving_mean and moving_variance). It usually got from the
760
760
pre-trained model. Calculated as follows:
@@ -832,7 +832,7 @@ class BatchNorm3D(_BatchNormBase):
832
832
r"""
833
833
Applies Batch Normalization over a 5D input (a mini-batch of 3D inputswith additional channel dimension) as described in the paper Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift .
834
834
835
-
When track_running_stats = False, the :math:`\\mu_{\\beta}`
835
+
When use_global_stats = False, the :math:`\\mu_{\\beta}`
836
836
and :math:`\\sigma_{\\beta}^{2}` are the statistics of one mini-batch.
837
837
Calculated as follows:
838
838
@@ -843,7 +843,7 @@ class BatchNorm3D(_BatchNormBase):
0 commit comments