Given the dynamical system $$ \begin{cases} \dot x = -(c - x^2 - y^2) y\\ \dot y = (x^2 + y^2) x \end{cases} $$ My aim is to study the stability at the origin. My feeling is that the origin is stable so, I should fine a Lyapunov in other to conclude.
Defintioon Given an autonomous system $$\dot x = f(x(t))$$ a Lyapunov function for this system at an equilibrium $x_0$ is any differentialbe function
$$ V: U_{x_0}\to \mathbb R$$ defines on a small neighborhood $U_{x_0}$ of $x_0$ such that,
$\bullet$ $V(x_0) =0$ and $V(x)>0$ for $x\neq 0$
$\bullet$ $\dot V(x(t)) \le 0$ for $x(t)\neq 0$.
This system is invariant under $t \to -t$, $x \to -x$, $y \to -y$. Thus if there are solutions that approach the origin as $t \to +\infty$, there are also solutions that approach the origin as $t \to -\infty$. The only way you can have a Lyapunov function $V$ is if $\dot{V} = 0$. Then the function $V$ is an invariant, and the level curves of $V$ are trajectories.
In fact there is one:
$$ V = -2 x^2 + 2 y^2 - c \ln(1 - 2 x^2/c - 2 y^2/c) $$
If $c > 0$ this is positive for $x, y \ne (0,0)$ and sufficiently close to $(0,0)$: the origin is stable (but not asymptotically stable). However, for $c < 0$ it takes both positive and negative values, and the curves $V = 0$ are trajectories showing that the origin is not stable in this case.