The matrix exponential on skew-symmetric $3\times3$ matrices onto $SO(3)$ is not local homeomorphism everywhere. I have been instructed that one problem is with the spheres of radius $2n\pi$ ($n\in\mathbb{N}$) in the scaled Frobenius norm $\|\,\|=\frac{1}{\sqrt{2}}\|\,\|_F$. As I understand this $\exp$ is $C^\infty$ smooth and injection on the open ball of radius $\pi$.
I would like to know what is the radius of the largest open ball around zero where this matrix $\exp$ is a local homeomorphism, or maybe even diffeomorphism? Even better an explanation, a proof or a reference to the proof should be given.
In essence, I see there needs to be shown that for every $X$ in such a ball, the differential (pushforward) $\mathrm{d}_{\exp(X)}$ is linear isomorphism. I lack the knowledge of differential geometry to proceed.
This is the sketch of differential on a smooth map between manifolds from Wikipedia:
In this case we have $$ \begin{array}{cccc} & \mbox{Domain} & \mbox{Mapping} & \mbox{Target set}\\ \mbox{Manifold} & M=\mathbb{R}_{{\rm skew}}^{3\times3} & \overset{\varphi(X)=\exp X}{\longrightarrow} & N=SO(3)\\ \mbox{Tangent space} & T_{X}M=\mathbb{R}_{{\rm skew}}^{3\times3} & \overset{\mathrm{d}_{\varphi(X)}}{\longrightarrow} & T_{\varphi(X)}N=? \end{array} $$
Differential of $\varphi$ at $X$ is a linear map $\mathrm{d}_{\varphi(X)}:T_{X}M\to T_{\varphi(X)}N$ that can be computed like this $${\rm d}_{\varphi(X)}\underset{\begin{array}{c} \uparrow\\ \blacksquare \end{array}}{\left(\,\gamma'(0)\,\right)}=\left(\varphi\circ\gamma\right)'(0)$$ where $\gamma$ is a curve such that $\gamma(0)=X$. As a linear map, the differential is fully determined by it's action on a basis in $T_{X}M$. Therefore the symbol $\blacksquare$ denotes a place where we want to insert one by one elements of a basis for $T_{X}M$. If $\{{\bf b}_{i}\}_{i=1}^{n}$ is a basis in $T_{X}M$, and ${\bf v}=\sum_{i=1}^{n}v_{i}{\bf b}_{i}$ where $v_{i}$ are scalars (coordinates), then we know that ${\rm d}_{\varphi\left(X\right)}{\bf v}=\sum_{i=1}^{n}v_{i}{\rm d}_{\varphi\left(X\right)}{\bf b}_{i}$. To check that ${\rm d}_{\varphi\left(X\right)}$ is an isomorphism we only need to check that $\{{\rm d}_{\varphi(X)}{\bf b}_{i}\}_{i=1}^{n}$ is a linearly independent set.
Let us use the Rodrigues' rotation formula to ease the computation (for $B\in\mathbb{R}_{{\rm skew}}^{3\times3}$): $$ \exp B={\rm Id}+\frac{\sin\left\Vert B\right\Vert }{\left\Vert B\right\Vert }B+\frac{1-\cos\left\Vert B\right\Vert }{\left\Vert B\right\Vert ^{2}}B^{2}\in SO(3)\mbox{.} $$
My first try was to insert the elements of the canonical orthonormal basis for $\mathbb{R}_{{\rm skew}}^{3\times3}$ in $\blacksquare$. We can do that by choosing $\gamma_{i}(t)=X+tA_{i}$, so that $\gamma_{i}'(0)=A_{i}$ where $$ A_{1}=\left(\begin{array}{ccc} 0\\ & 0 & -1\\ & 1 & 0 \end{array}\right),\quad A_{2}=\left(\begin{array}{ccc} 0 & & 1\\ & 0\\ -1 & & 0 \end{array}\right),\quad A_{1}=\left(\begin{array}{ccc} 0 & -1\\ 1 & 0\\ & & 0 \end{array}\right). $$ Then, for $X=\left(\begin{array}{ccc} 0 & -x_{3} & x_{2}\\ x_{3} & 0 & -x_{1}\\ -x_{2} & x_{1} & 0 \end{array}\right)$ we have (using the Rodrigues' formula) $$ {\rm d}_{\varphi(X)}A_{i}=\frac{{\rm d}}{{\rm d}t}\exp\left(X+tA_{i}\right)_{t=0}=\frac{f(\left\Vert X\right\Vert )x_{i}}{\left\Vert X\right\Vert }X+\frac{\sin\left\Vert X\right\Vert }{\left\Vert X\right\Vert }A_{i}+\frac{g(\left\Vert X\right\Vert )x_{i}}{\left\Vert X\right\Vert }X+\frac{1-\cos\left\Vert X\right\Vert }{\left\Vert X\right\Vert ^{2}}2X.A_{i} $$ where $f(u)\overset{{\rm def}}{=}\frac{u\cos u-\sin u}{u^{2}}=\frac{\mathrm{d}}{\mathrm{d}u}\left(\frac{\sin u}{u}\right)$ and $g(u)\overset{{\rm def}}{=}\frac{u\sin u-2+2\cos u}{u^{3}}=\frac{\mathrm{d}}{\mathrm{d}u}\left(\frac{1-\cos u}{u^{2}}\right)$. Within $X.A_{i}$, the dot stands for matrix multiplication. Unfortunately, I am not able to see that $\{{\rm d}_{\varphi(X)}A_{i}\}_{i=1}^{3}$ is linearly independent, unless $X=O$. It seems as if plugging the easiest choices into $\blacksquare$ resulted with a complicated right hand side in the same formula. But at least we have proved that ${\rm d}_{\exp}$ is isomorphism at $X=O$, that is $\exp$ is local diffeomorphism at $O\in\mathbb{R}_{{\rm Skew}}^{3\times3}$.
Therefore, I started again from the beginning, this time trying to choose a basis that will result in the simplest result on the right hand side (after differentiation). Provided $X\in\mathbb{R}_{{\rm skew}}^{3\times3}$ is set, note that for each $y\in\mathbb{R}^{3}$ we have $X.y=\left(\begin{array}{c} x_{1}\\ x_{2}\\ x_{3} \end{array}\right)\times y$ (with $X.y$ I denoted matrix multiplying a vector). Provided with $X\neq O$, I choose $a=\left(\begin{array}{c} a_{1}\\ a_{2}\\ a_{3} \end{array}\right)$ and $b=\left(\begin{array}{c} b_{1}\\ b_{2}\\ b_{3} \end{array}\right)$ such that $\left\Vert a\right\Vert =1=\left\Vert b\right\Vert$ and $a\times\frac{x}{\left\Vert x\right\Vert }=b$, $\frac{x}{\left\Vert x\right\Vert }\times b=a$ (we have $a\bot b$, $a\bot x$ and $b\bot x$). Let $$A=\left(\begin{array}{ccc} 0 & -a_{3} & a_{2}\\ a_{3} & 0 & -a_{1}\\ -a_{2} & a_{1} & 0 \end{array}\right)\mbox{ and }B=\left(\begin{array}{ccc} 0 & -b_{3} & b_{2}\\ b_{3} & 0 & -b_{1}\\ -b_{2} & b & 0 \end{array}\right)\mbox{.} $$ Then we have $A.y=a\times y$ and $B.y=b\times y$. Now I will use different $\gamma_{i}$, $$ \gamma_{1}(t)=X+tX,\gamma_{1}'(0)=X,\quad\gamma_{2}(t)=X+tA,\gamma'(0)=A,\quad\gamma_{2}(t)=X+tB,\gamma'(0)=B\mbox{.} $$ We can check that $\{X,A,B\}$ is orthogonal base in $\mathbb{R}^{3\times3}$ using the following inner product on matrices: $A:B=\frac{1}{2}{\rm Tr}\left(A^{T}.B\right)$, where ${\rm Tr}$ denotes the matrix trace. We have $A:B=a\cdot b=0$, $A:X=a\cdot x=0$ and $B:X=b\cdot x=0$ (dot denotes the ordinary vector scalar product). Therefore, $A\bot B$, $A\bot X$ and $B\bot X$.
Let us also here establish some other facts that will be used later. Let us show that $\{X,\, A,\, B,\, X^{2},\, X.A,\, X.B\}$ is linearly independent (evenmore orthogonal) set. We have \begin{eqnarray*} x\times\left(x\times\left(x\times y\right)\right) & = & x\times\left(x\left(x\cdot y\right)-y\left(x\cdot x\right)\right)\qquad\left\{ \begin{array}{c} \mbox{vector}\\ \mbox{triple}\\ \mbox{product} \end{array}\right\} \\ &=& \left(x\cdot y\right)x\times x-\left(x\cdot x\right)x\times y\qquad\left\{ \begin{array}{c} \mbox{distributive}\\ \mbox{property} \end{array}\right\} \\ &=& -\left\Vert x\right\Vert ^{2}\, x\times y \end{eqnarray*} so we conclude $X^{3}=-\left\Vert X\right\Vert ^{2}X\in\mathbb{R}_{{\rm Skew}}^{3\times3}$. Therefore $X:X^{2}=\frac{1}{2}{\rm Tr}\left(X^{T}.X^{2}\right)=\frac{1}{2}{\rm Tr}\left(-X^{3}\right)=0$. On the other hand, by using vector triple product and orthogonality between $x$, $a$ and $b$ \begin{eqnarray*} X^{2}.A.y &=& x\times\left(x\times\left(a\times y\right)\right) =x\times\left((x\cdot y)\, a\right)=\left\Vert x\right\Vert (x\cdot y)\, b,\\ X.B.y &=& x\times\left(b\times y\right) =(x\cdot y)\, b\mbox{ .} \end{eqnarray*} Therefore $X^{2}.A=X.B$, so together with $X:X.A=-{\rm Tr}\left(X^{2}.A\right)=-X^{2}:A$ we get $X:X.A=-X^{2}:A=-{\rm Tr}\left(X.B\right)=X:B=0$. In the same manner we get that all pairs in $\{X,\, A,\, B,\, X^{2},\, X.A,\, X.B\}$ are orthogonal.
Back to our differential, from Rodrigues' formula we get \begin{eqnarray*} {\rm d}_{\varphi(X)}X &=& \frac{{\rm d}}{{\rm d}t}\exp\left(X+tX\right)_{t=0}=\left(f(\left\Vert X\right\Vert )\left\Vert X\right\Vert +\frac{\sin\left\Vert X\right\Vert }{\left\Vert X\right\Vert }+g(\left\Vert X\right\Vert )\left\Vert X\right\Vert \right)X+2\frac{1-\cos\left\Vert X\right\Vert }{\left\Vert X\right\Vert ^{2}}X^{2},\\ {\rm d}_{\varphi(X)}A &=& \frac{{\rm d}}{{\rm d}t}\exp\left(X+tA\right)_{t=0}=\frac{\sin\left\Vert X\right\Vert }{\left\Vert X\right\Vert }A+2\frac{1-\cos\left\Vert X\right\Vert }{\left\Vert X\right\Vert ^{2}}X.A,\\ {\rm d}_{\varphi(X)}B &=& \frac{{\rm d}}{{\rm d}t}\exp\left(X+tB\right)_{t=0}=\frac{\sin\left\Vert X\right\Vert }{\left\Vert X\right\Vert }B+2\frac{1-\cos\left\Vert X\right\Vert }{\left\Vert X\right\Vert ^{2}}X.B\,\mbox{.} \end{eqnarray*} The final point to see is that $\{{\rm d}_{\varphi(X)}X,\,{\rm d}_{\varphi(X)}A,\,{\rm d}_{\varphi(X)}B\}$ is linearly independent set, evenmore orthogonal. Notice that each one out of $\{{\rm d}_{\varphi(X)}X,\,{\rm d}_{\varphi(X)}A,\,{\rm d}_{\varphi(X)}B\}$ is a linear combination of two different elements out of six in orthogonal set $\{X,\, A,\, B,\, X^{2},\, X.A,\, X.B\}$. Therefore, unless one of the elements in $\{{\rm d}_{\varphi(X)}X,\,{\rm d}_{\varphi(X)}A,\,{\rm d}_{\varphi(X)}B\}$ is actually a trivial combination, we have proved that ${\rm d}_{\varphi(X)}$ is isometry, that is $\exp$ is a local diffeomorphism. Note that ${\rm d}_{\varphi(X)}A=O={\rm d}_{\varphi(X)}B$ if and only if $\left\Vert X\right\Vert =n\pi,\, n\in\mathbb{N}$. Furthermore, ${\rm d}_{\varphi(X)}X$ can not become zero unless the factor $\frac{1-\cos\left\Vert X\right\Vert }{\left\Vert X\right\Vert ^{2}}$ becomes zero, which can not happen when $\left\Vert X\right\Vert \neq n\pi,\, n\in\mathbb{N}$. Together with what we already have for $X=0$, we arrived at the conclusion that $\exp$ is a local diffeomorphism on $\mathbb{R}^{3\times 3}_{\rm Skew}$, except on the spheres of radius $2n\pi$, $n\in\mathbb{N}$.
I am inexperienced in differential geometry calculations, so please do not hesitate to be hairsplitting. I would like to get this right.