If we consider the Hadamard product of matrices (elementwise product) and the conventional product of matrices (composition of operators), when do they coincide?
I see that if both matrices are diagonal, both types of product are the same. But is the converse true?
More of an exploration, that's too big for a comment. Using the Hadamard product example, from Wikipedia:
$\begin{pmatrix} a_{11}&a_{12}&a_{13}\\a_{21} &a_{22}&a_{23}\\a_{31}&a_{32}&a_{33} \end {pmatrix} \circ\begin{pmatrix} b_{11}&b_{12}&b_{13}\\b_{21} &b_{22}&b_{23}\\b_{31}&b_{32}&b_{33} \end {pmatrix}=\begin{pmatrix} \color{blue}{a_{11}b_{11}}&a_{12}b_{12}&a_{13}b_{13}\\a_{21}b_{21}&\color{blue}{a_{22}b_{22}}&a_{23}b_{23}\\a_{31}b_{31}&a_{32}b_{32}&\color{blue}{a_{33}b_{33}} \end {pmatrix}$
we need to equate this to:
$\begin{pmatrix} a_{11}&a_{12}&a_{13}\\a_{21} &a_{22}&a_{23}\\a_{31}&a_{32}&a_{33} \end {pmatrix}\begin{pmatrix} b_{11}&b_{12}&b_{13}\\b_{21} &b_{22}&b_{23}\\b_{31}&b_{32}&b_{33} \end {pmatrix}=\begin{pmatrix} \color{blue}{a_{11}b_{11}}+a_{12}b_{21}+a_{13}b_{31}&a_{11}b_{12}+a_{12}b_{22}+a_{13}b_{32}&a_{11}b_{13}+a_{12}b_{23}+a_{13}b_{33}\\ a_{21}b_{11}+a_{22}b_{21}+a_{23}b_{31}&a_{21}b_{12}+\color{blue}{a_{22}b_{22}}+a_{23}b_{32}&a_{21}b_{13}+a_{22}b_{23}+a_{23}b_{33}\\ a_{31}b_{11}+a_{32}b_{21}+a_{33}b_{31}&a_{31}b_{12}+a_{32}b_{22}+a_{33}b_{32}&a_{31}b_{13}+a_{32}b_{23}+\color{blue}{a_{33}b_{33}}\\ \end {pmatrix}$
we can see that, for example, $a_{12}b_{21}+a_{13}b_{31}=0$ these sums only work if they are cancelling so either $b_{21}=b_{31}\land a_{12}+a_{13}=0$, or $a_{12}=a_{13}\land b_{21}+b_{31}=0$ are the simplest two cases ( yes there are more, where additive inverses, and equality, get involved. To keep this diagonal the same, these are neccessary, but not sufficient conditions)