Let the quadratic form $F(x,y,z)$ be given as below
$F(x,y,z)=2x^2+3y^2+5z^2-xy-xz-yz$
Find the transitional matrix that would transform this form to a diagonal form.
I got the symmetric coefficient matrix to be:
$\begin{pmatrix}2 & -\frac{1}{2} & -\frac{1}{2} \\-\frac{1}{2} & 3 & -\frac{1}{2} \\-\frac{1}{2} & -\frac{1}{2} & 5\end{pmatrix}$
i then got the characteristic polynomial :
$λ^3-10λ^2+\frac{121}{4}λ-30$
is it even possible to solve for λ?
Completing the square gives $2x^2+3y^2+5z^2-xy-xz-yz$
$=2\big(x^2-\frac{1}{2}(y+z)x+\frac{1}{16}(y+z)^2\big)+3y^2+5z^2-yz-\frac{1}{8}y^2-\frac{1}{8}z^2-\frac{1}{4}yz$
$=2\big(x-\frac{1}{4}(y+z)\big)^2+\frac{23}{8}y^2-\frac{5}{4}yz+\frac{39}{8}z^2$
$=2(x-\frac{1}{4}y-\frac{1}{4}z)^2+\frac{23}{8}\big(y^2-\frac{10}{23}yz+\frac{25}{23^2}z^2\big)+\frac{109}{23}z^2$
$=2(x-\frac{1}{4}y-\frac{1}{4}z)^2+\frac{23}{8}(y-\frac{5}{23}z)^2+\frac{109}{23}z^2$,
so letting $x^{\prime}=x-\frac{1}{4}y-\frac{1}{4}x, \;\;y^{\prime}=y-\frac{5}{23}z, \;\;z^{\prime}=z$
gives the transitional matrix
$\begin{pmatrix}1&-\frac{1}{4}&-\frac{1}{4}\\0&1&-\frac{5}{23}\\0&0&1\end{pmatrix}^{-1}=\begin{pmatrix}1&\frac{1}{4}&\frac{7}{23}\\0&1&\frac{5}{23}\\0&0&1\end{pmatrix}$
As shown in Will Jagy's answer, the transitional matrix can also be found by matrix reduction:
$\begin{pmatrix}2&-\frac{1}{2}&-\frac{1}{2}\\-\frac{1}{2}&3&-\frac{1}{2}\\-\frac{1}{2}&-\frac{1}{2}&5\end{pmatrix}\overset{\frac{1}{4}r_1+r_2}{\underset{\frac{1}{4}c_1+c_2}{\longrightarrow}}\begin{pmatrix}2&0&-\frac{1}{2}\\0&\frac{23}{8}&-\frac{5}{8}\\-\frac{1}{2}&-\frac{5}{8}&5\end{pmatrix}\overset{\frac{1}{4}r_1+r_3}{\underset{\frac{1}{4}c_1+c_3}{\longrightarrow}}\begin{pmatrix}2&0&0\\0&\frac{23}{8}&-\frac{5}{8}\\0&-\frac{5}{8}&\frac{39}{8}\end{pmatrix}\overset{\frac{5}{23}r_2+r_3}{\underset{\frac{5}{23}c_2+c_3}{\longrightarrow}}\begin{pmatrix}2&0&0\\0&\frac{23}{8}&0\\0&0&\frac{109}{23}\end{pmatrix}$
Performing the same row operations on the identity matrix gives
$\begin{pmatrix}1&0&0\\0&1&0\\0&0&1\end{pmatrix}\longrightarrow\begin{pmatrix}1&0&0\\\frac{1}{4}&1&0\\0&0&1\end{pmatrix}\longrightarrow\begin{pmatrix}1&0&0\\\frac{1}{4}&1&0\\\frac{1}{4}&0&1\end{pmatrix}\longrightarrow \begin{pmatrix}1&0&0\\\frac{1}{4}&1&0\\\frac{7}{23}&\frac{5}{23}&1\end{pmatrix}=S$,
so the transitional matrix is given by $S^{T}=\begin{pmatrix}1&\frac{1}{4}&\frac{7}{23}\\0&1&\frac{5}{23}\\0&0&1\end{pmatrix}$