While the word "normal" is one of the most overloaded mathematical terms, in linear algebra, it is usually associated with the notion of being perpendicular to something, as in "normal vector" or "normal matrix" (which has a set of mutually perpendicular eigenvectors).
However, the word "normal" does not seem to mean its normal/ordinary/usual meaning in English. So, why is a normal vector or matrix called "normal"?
From the OED Third Edition, an entry updated December 2003:
In short, it goes back to the Latin source of the word.