There are BatchNormalization layers in my model. Can I open the BatchNormalization of the model and estimate the mean and variance of the BN when I evaluate my model?
Posted by: lilei @ July 2, 2022, 9:12 a.m.Hi, thanks for your interest. You can NOT open bn during testing as it will inherently hack the test data distribution.
Posted by: Wang_Tan @ July 5, 2022, 5:34 a.m.How about LayerNormalization？ I Use layer norm at beginning of the model.
Posted by: Arashikagi @ July 8, 2022, 2:49 p.m.Hi, you can use it as long as it is frozen during testing.
Posted by: Wang_Tan @ July 9, 2022, 5:12 a.m.