Proof: Ratio of matrix traces and difference of traces

671 Views Asked by At

$\newcommand{\Tr}{\operatorname{Tr}}$

Am looking for a proof that shows that the minimization of $\frac{\Tr X^TAX}{\Tr X^TBX}$ is equivalent to the minimization of $\Tr X^TAX-\lambda \Tr X^TBX$ for some scalar $\lambda$

1

There are 1 best solutions below

2
On BEST ANSWER

Minimizing $f(X)$ with respect to $X$ is equivalent to first minimizing $f(X)$ with respect to $X$ under the constraint $g(X)=c$ and then minimizing the result with respect to $c$. Thus the minimum with respect to $X$ must be the minimum with respect to $X$ under the constraint $g(X)=c$ for some value of $c$, and to find that you can introduce a Lagrange multiplier. Now you just need to replace the denominator by the constant $c$ to arrive at your result.