I have this system of equations:
$$\dot{x}=x-y-x(x^2+y^2)+\frac{xy}{\sqrt{x^2+y^2}} \\ \dot{y}=x+y-y(x^2+y^2)-\frac{x^2}{\sqrt{x^2+y^2}}$$
How can I get this in polar coordinates ? I know that $r^2=x^2+y^2$, but how can I find $\dot{r}$ or $\dot{\theta}$ ?
When we use polar co-ordinates, we let $x=r\cos\theta$ and $y=r\sin \theta$. We can differentiate each of these equations to find $\dot{x}$ and $\dot{y}$ (and this will help you solve your question). If you want to find $\dot{r}$ or $\dot{\theta}$, just differentiate the equations $\tan\theta=y/x$ and $r^{2}=x^{2}+y^{2}$ implicitly.
For example, $$\dot{x}=\frac{d}{dt}(r\cos\theta)=\frac{dr}{dt}\cos\theta-r\sin\theta\frac{d\theta}{dt}=\dot{r}\cos\theta-r\dot{\theta}\sin\theta$$