Given a matrix random variable $X \in \mathbb{R}^{d \times d}$ is there a concentration or any interesting upper-bound on the following expression:
- $ \mathbb{E}[||\mathbb{E}[X]-X||] \leq ??$
Information I have are spectral properties of the mean $\mathbb{E}[X]$.
- Secondly, given that we have another estimator $S_n=\frac{1}{n} \sum_{i=1}^n X_i$ where $X_i$ (iid) like the random variable $X$ can I say something, about $ \mathbb{E}[||\mathbb{E}[S]-S||] $ where the expectation is on all $X_i$s.
The only idea I had first was to use Jensen's inequality with: $ \leq \mathbb{E}_{X,Y}[|| X - Y||]$, which leads again nowhere.