From 17f0dde5ba62ae0cffdfcb037d54574a1a713385 Mon Sep 17 00:00:00 2001 From: Xiafei Mao <34890665+xiafeimao@users.noreply.github.com> Date: Sat, 9 Oct 2021 10:55:12 +0800 Subject: [PATCH] Update Operators.md Change the formula of BatchNorm Op --- docs/Operators.md | 6 ++---- 1 file changed, 2 insertions(+), 4 deletions(-) diff --git a/docs/Operators.md b/docs/Operators.md index 4f272b7..e782f86 100644 --- a/docs/Operators.md +++ b/docs/Operators.md @@ -153,9 +153,7 @@ rank as the input. This is the reverse transformation of Space2Batch. Carries out batch normalization as described in the paper https://arxiv.org/abs/1502.03167. -$$\hat x_i\leftarrow \frac{x_i-\mu_\mathcal{B}}{\sqrt{\sigma_\mathcal{B}^2+\epsilon}}$$ - -$$y_i=\gamma\hat x_i+\beta\equiv BN_{\gamma,\beta}(x_i)$$ +Y = (X - Mean) / Sqrt( Var + Eps) * Gama + Beta ## Clip @@ -767,4 +765,4 @@ how to bind input/output: take unidirectional_sequence_lstm_test.cc Unpacks the given dimension of a rank-R tensor into rank-(R-1) tensors. - axis : An int. The axis to unstack along. Defaults to the first dimension. -Negative values wrap around, so the valid range is [-R, R). \ No newline at end of file +Negative values wrap around, so the valid range is [-R, R).