Frobenius Norm of Hadamard Product and Trace

1.6k Views Asked by At

I'm trying to relate the Frobenius Norm of a Hadamard Product to a trace that does not include another Hadamard Product, if possible. In other words, if A and B are (sxr) matrices, with not all positive values,

$\left||A\circ B \right||^2_F = $?

I'm trying to relate the sum of the squares of all the entries of the Hadamard product. I know that the sum of all the entries of the Hadamard product are

$\sum_i \sum_j (A\circ B)_{ij} = tr(A B^T) $

and also

$\left||A\circ B \right||^2_F = tr((A\circ B)^T(A\circ B)) $

But I am trying to get $\left||A\circ B \right||^2_F $ in the form of the trace of some combination of A and B, without a Hadamard product. Even an inequality would help. I've tried various identities and inequalities related to Hadamard Product and Frobenius Norm, but I am not having any luck.

Any suggestions would be appreciated.

2

There are 2 best solutions below

2
On

Let $$\eqalign{ D_a &= {\rm Diag}({\rm vec}(A)) \cr D_b &= {\rm Diag}({\rm vec}(B)) \cr }$$ Then $$\eqalign{ \|A\circ B\|_F^2 &= \|D_aD_b\|_F^2 = {\rm tr}(D_a^2D_b^2) \cr }$$

0
On

Since $\Vert A\Vert_F^2=\text{tr}(A^TA)=\sum_{i,j}A_{ij}^2$ for any matrix $A$, we have $$\Vert A\circ B\Vert_F^2=\sum_{i,j}(A\circ B)_{ij}^2=\sum_{i,j}A_{ij}^2B_{ij}^2.$$ You can use this to get a silly lower bound on $\Vert A\circ B\Vert_F^2$ in terms of traces of $A$ and $B$ via Cauchy-Schwarz. If $A,B\in\mathbb{R}^{m\times n}$, then $\Vert A\circ B\Vert_F^2\geq {1\over mn}\text{tr}(A^TB)^2$.