I saw this exam problem but I'm having trouble how to determine the local maxima and the minima of this function.
This is what I did.
I found $f_x=2x+2z+yz \\ f_y=2y+2z+xz \\ f_z=4z+2y+2x+xy$
One stationary point I know it's $A(0,0,0)$ but I can't find the others. I thought of using Sylvester's criterion.
$\Delta _1=f_{xx}=2 \gt 0 \\$
$\Delta_2= \begin{vmatrix} f_{xx} & f_{xy} \\ f_{yx} & f_{yy}\\\end{vmatrix} $
$ \Delta _3= \begin{vmatrix} f_{xx} & f_{xy} & f_{xz} \\ f_{yx} & f_{yy} & f_{yz} \\ f_{zx} & f_{yz} & f_{zz} \\ \end{vmatrix}$
For the point, $A$ I get $\Delta _2(A)=4 \gt 0$ and $\Delta _3(A)=0$. This is where I got stuck and I don't know what I should do. Can somebody help me find the other stationary points and help me to underestand what to do when I have the case $\Delta _3=0$?
$f(x,x,-x)=-x^3$ and $f(0,0,0)=0$. This shows: in each neighborhood of $(0,0,0)$ the function $f$ takes values $<0$ and values $>0$.
Consequence: in $(0,0,0)$ the function $f$ does not have a local extremum.