Say we have a multivariate distribution with covariance matrix $P$. What is the variance in the direction of an arbitrary vector $v$?
Eigenvectors of $P$ are the directions of greatest variance, and eigenvalues are informative of how much variance is in the direction of their corresponding eigenvector. How can the variance be calculated for the direction of any other vector?