Given an autonomous ode $\dot{x}=F(x)$ with $0$ being its equilibrium point, and all eigenvalues of $DF(0)$ have non-zero real parts.
I have learned that if the real parts of eigenvalues are all negative , then the system is asymptotically stable near $0$. Now I guess that if one of the eigenvalues has positive real part then the system is unstable near $0$, but I can't give a proof, can anyone help me?
Many thanks!
You are comparing two systems of differential equations, the linear system $$ \dot v=Av $$ and the non-linear system $$ \dot x=F(x) $$ with $F(0)=0$ a stationary point at the origin and $DF(0)=F'(0)=A$ as the Jacobian. If $F$ is sufficiently smooth, say twice differentiable at least, the vector fields look similar close to the origin.
Now if one eigenvalue of $A$ is real and positive, or a conjugate eigenpair has a positive real part, then there are solutions of the linear system that connect the stationary point with infinity moving outwards. The question asks if the non-linear system is similar enough that solutions close-by inherit enough of this divergence to prevent this point from being stable.
The Hartman-Grobman theorem answers this in the most comprehensive way (lesser tools may be able to also answer this with more effort) by the claim that there is some diffeomorphism $\Phi$ mapping a neighborhood of the origin in the linear system to a neighborhood of the stationary point of the non-linear system (here also the origin) with $Φ(x)=x+O(|x|^2)$ so that $$x(t)=Φ(e^{At}v_0)$$ is the solution of $$\dot x=F(x)~~\text{ with }~~x_0=Φ(v_0)\iff v_0=Φ^{-1}(x_0)$$ for $x_0$ close to the fixed point $0$ and $t$ small enough.
Now if $A$ has an eigenvalue $\lambda=\alpha+i\beta$ with positive real part $α$, then there will be an eigenvector $u+iw$ leading to real solutions $e^{αt}(\cos(βt)u-\sin(βt)w)$ for the linear equation and thus $$ x(t)=Φ(v(t))=Φ\bigl(e^{αt}(\cos(βt)u-\sin(βt)w)\bigr) $$ (for a real positive eigenvalue just set $β=0$). Now if you fix some point $x(t_*)$ on this solution that is still inside the range of the diffeomorphism, then the points $x_0=x(t_0)$, $t_0<t_*$ can be selected arbitrarily close to the origin (select $β(t_*-t_0)\in 2\pi\Bbb Z$ to get points on the same ray to the origin). Thus you get initial points arbitrarily close to the origin that have solutions that pass through the same point $x(t_*)$ (relatively) far away from the origin. This is then a contradiction to both definitions of stability and asymptotic stability.