Find the derivative of $ Tr( A ) $ in the direction of matrix $B$.

Question

Let $M(n)$ be the space of $n\times n$ real matrices. Let Tr: $M(n)\rightarrow\mathbb{R}$ where Tr($A$) is the trace of matrix $A$. Find the derivative of Tr($A$) in the direction of matrix $B$.

I'm not sure how one would take the derivative of the trace operator to begin with--would I put it in terms of the summation $\sum_{i=1}^na_{i,i}$? And to make it a directional derivative, I multiply the derivative by the matrix $B$?

Any help is appreciated!

Answer 1

The derivative in question is given by

$ \lim_{t \to 0} \frac{Tr(A+tB)-Tr(A)}{t}$

Now we have $Tr(A+tB)-Tr(A)=tTr(B)$

Your turn !

Answer 2

To, find the directional derivative of $ Trace (A) $ along the matrix $B$ , we first define a function $ f(X)=Tr(AX) $ , where $ X $ is a matrix in $ M(\mathbb{R}^{n}) $ . $$ $$ Then $ D_{B}f(X) $= $ \lim_{t \rightarrow 0} \frac{f(X+tB)-f(X)}{t}= \lim_{t \rightarrow 0}\frac{Tr(A(X+tB)-Tr(AX)}{t} $ , $$ $$or, $ D_{B}f(X)=\lim_{t \rightarrow 0 } \frac{Tr(AX)+t Tr(AB)-Tr(AX)}{t}=\lim_{ t \rightarrow 0}\frac{t Tr(AB)}{t}=Tr(AB)=Tr(B^{T}A^{T}) $ , $$ $$or, $ D_{B}f(X)=Tr(B^{T}A^{T}) $, $$ $$ , or, $D_{B}f(I)=Tr(B^{T}A^{T})$ , where I is the identity matrix in $ \mathbb{R}^{n}$ , $$ $$ , or,$ D_{B}Tr(A)=Tr(B^{T}A^{T}) $ , since $ f(I)=Tr(A I)=Tr(A)$.