Nearest symmetric matrix with respect to the spectral norm

271 Views Asked by At

I want to prove (or disprove) the following:

Given an arbitrary square matrix, $A$, of size $(n \times n)$, and the matrix $A_S$ defined by $$A_S= \frac{A+A^T}{2}$$ prove that $A_S$ is the nearest symmetric matrix to $A$ with respect to the spectral norm.

That is, prove that:

$$A_S = \arg\min_{\tilde{A}\in S} \|A-\tilde{A}\|_2$$

Where $S$ is the set of all $(n \times n)$ symmetric matrices.

But I am unsure where to start... does anyone have any suggestions on how to tackle this problem? In addition, if the above is not true, what would be the nearest symmetric matrix to $A$ in the above sense?

2

There are 2 best solutions below

1
On BEST ANSWER

As shown in Rahul's answer, the statement as it stands is false. $A_S$ is not necessarily the nearest symmetric matrix to $A$, because there can be other symmetric matrices that are equally close to $A$.

However, $A_S$ is always a global minimiser of $\|A-X\|$ over all (real or complex) symmetric matrices $X$. Let $K=(A-A^T)/2$. For any symmetric matrix $X$, we have \begin{aligned} 2\|K\|&=\|(K-X)+(K+X)\|\\ &\le\|K-X\|+\|K+X\|\\ &=\|K-X\|+\|-K-X\|\\ &=\|K-X\|+\|(K-X)^T\|\\ &=2\|K-X\|. \end{aligned} Therefore, given any symmetric matrix $S$, if we put $X=S-A_S$, we obtain $$ \|A-A_S\|=\|K\|\le\|K-X\|=\|A-S\|. $$ Note that this proof applies as long as $\|M\|=\|M^T\|$. In particular, the inequality still holds if the norm in question is replaced by Frobenius norm or any Ky Fan $k$-norm. It doesn't even have to be a submultiplicative norm. Any vector $p$-norm $\|M\|:=\|\operatorname{vec}(M)\|_p$ can be used as well.

1
On

The minimizer is not necessarily unique. For example take $A=\begin{bmatrix}&1&\\-1&&\\&&0\end{bmatrix}$, $A_S=0$, $\tilde A=\begin{bmatrix}0&&\\&0&\\&&1\end{bmatrix}$. Then $\|A-A_S\|_2=1=\|A-\tilde A\|_2$.