How to check whether f is a convex and find all stationary points

Question

Here is the problem

What I attempted was calculating the Hessian and trying to prove that it's positive definite/semi-definite or negative definite/semi-definite. It doesn't seam to work as I am getting that the second order principle minor can be both negative and positive which would suggest that this function is neither convex nor concave.