Intuition Behind Xavier Initialization

33 Views Asked by At

Can anyone explain why to compromise between the variances 1/n_in and 1/n_out its 2/(n_in+n_out) its not an average or a harmonic mean it seems random to me?enter image description here

The full paper is here:https://proceedings.mlr.press/v9/glorot10a.html