I tried to find the critical points of the function
$$f(x,y) = x^2y-2xy + \arctan y $$
And I found that is $P(1,0)$, the problem is that the Hessian is null, and I don't know how to procede to determine the nature of that point. Can you help me ?
Update: Thanks you all, and I tried to study the sign of the function, the problem is that I don't know how to proceed , since I have $Δf(x,y)=x^2y-2xy + \arctan y $ and I don't know how to study the sign locally around $1,0$.
$f(1,0)=0$, $f(1,1)<0$ and $f(3,1)>0$, so $(1,0)$ is a saddle point.