Assume differential equation
$$ x'=2x+y+x \cos t-y \sin t $$ $$ y'=-x+2y-x\cos t+y \sin t $$
- Show that solution $(x(t),y(t))=(0,0)$ is unstable.
- Is there a non-trival solution such that $\lim_{t\to \infty}(x(t),y(t))=(0,0)$.
for question 2 , I think there exist a non-trival solution such that $\lim_{t\to \infty}(x(t),y(t))=(0,0)$ and it shows that having zero limit at infinity doesn't show stablity.

First question
Multiply the first equation by $x'$, the second by $y'$ and add: $$ x\,x'+y\,y'=2(x^2+y^2)+x^2\cos t+y^2\,\sin t-2\,x\,y\cos t\sin t. $$ If $0\le t\le\pi/2$ then $0\le\cos t\le1$, $0\le\sin t\le1$ and $$\begin{align} x^2\cos t+y^2\,\sin t-2\,x\,y\cos t\sin t&\ge x^2\cos^2 t+y^2\,\sin^2 t-2\,x\,y\cos t\sin t\\ &=(x\cos t-y\sin t)^2\\ &\ge0. \end{align}$$ Thus, if $0\le t\le\pi/2$ then $$ (x^2+y^2)'\ge4(x^2+y^2). $$ Integrating $$ x^2+y^2\ge(x(0)^2+y(0)^2)e^{4t},\quad 0\le t\le\frac\pi2. $$