There are two reasons to focus on "gaussianity". (1) Orthogonal transformations of gaussian distributions are again gaussian. (2) Mixing of signals tends to a gaussian distribution via Central Limit Theorem. The latter is very good reason, but I would like to focus on the correctness of the motivation in (1).
The Gaussian distribution is hardly the only distribution preserved under orthogonal transformations. Take any distribution, and consider its average over possible rotations. The uniform distribution on the set |x| < R fashions a non-exotic concrete example. All of these distributions should be untenable for independent component analysis (ICA).
Given that the Gaussian distribution is but one of many possible theoretical "problem distributions" that ICA should have difficulty with, (A)why all the fixation on the Gaussian distribution, and (B) does this pose practical concerns?
I was surprised not to find any tutorial that mentions this.
Relating to (B), It's possible that most measures of "nongaussianity" e.g. kurtosis are also measures of "non-rotation-invariance", but I would like a second opinion on this.