A tilted right circular cone with apex angle $2 \theta_c = 45^\circ$ (where $\theta_c$ is the semi-vertical angle), has its apex at the point $A(a_x, a_y, a_z)$ with $a_x, a_y, a_z \gt 0$, such that its intersection with the $xy$ plane is given by
$$ 5 x^2 - 4 xy + 9 y^2 = 64 $$
Find the coordinates of the apex $A$.
My attempt:
First I identified the major and minor axes of the ellipse of intersection, their direction, and the eccentricity. From the eccentricity and the known semi-vertical angle, I calculated the angle between the normal to the $xy$ plane and the axis of the cone. Then used the angle bisector theorem to deduce the location of the point where the axis intersects the $xy$ plane and the distance between the apex and that intersection point. From there, I computed the coordinates of the apex.

Look at $$5x^2 - 4xy + 9y^2 +z(Ax +B y + C z + D) - 64=0$$ which has the required intersection with $z=0.$
Then we have the condition $576A^2+256AB+320B^2-41D^2-10496C=0$ for it to be a cone (the determinant of the $4\times 4$ matrix).
$$5x^2 - 4xy + 9y^2 -64\\-(41D^2-320B^2-256AB-576A^2)\,z^2/10496 +z\,(Ax +B y + D)=0$$
We find the apex, the singular point, by solving the systems of partials: $$(x,y,z)=(-(128B+576A)/(41D), -(320B+128A)/(41D), 128/D)\tag1$$ and check that it indeed lies on the surface.
It remains to make it a right circular cone with aperture $\frac{\pi}{8}.$
Shifting the apex to the origin by the obvious translation
$$(41D^2-320B^2-256AB-576A^2)z^2-10496Byz-10496Axz\\-94464y^2+41984xy-52480x^2=0\tag2$$
we see that we have a homogeneous form.
Remember $\frac{\sqrt{2+\sqrt2}}{2}=\cos(\frac{\pi}{8})=\frac{n_x x+ n_y y+n_z z}{\sqrt{x^2+y^2+z^2}}$ where $\hat{n}=(n_x,n_y,n_z)$ is a unit vector along the axis. We get $$\frac{2+\sqrt2}{4}(x^2+y^2+z^2)=(n_x x+ n_y y+n_z z)^2\tag3$$
Comparing coefficients in $(2)$ and $(3)$, where $k$ is a scaling factor, we get the following system, solving it in maxima CAS, precomputed a grobner basis in M2, all the while remembering that $$n_x^2+n_y^2+n_z^2=1$$
And one of the solutions to this gives the positive octant apex:
the above solution substituted into $(1)$ gives the apex
$$({{\sqrt{ 13\,\sqrt{2}+16}\,\sqrt{35-5\,2\sqrt2}\,\left(1856-2^5\sqrt2\right)\,\sqrt{82}}\over{1681\,\sqrt{2}\,\sqrt{2344- 23\,2^5\sqrt2}}},{{\sqrt{13\,\sqrt{2}+16}\,\sqrt{35-5\,2\sqrt2}\,\left(59\,2^5\sqrt2-1920\right)\,\sqrt{82} }\over{1681\,\sqrt{2}\,\sqrt{2344-23\,2^5\sqrt2}}},{{2^4\sqrt{82}}\over{\sqrt{2344-23\,2^5\sqrt2}}})$$ $$\approx(5.116868190800648,2.119476201505111,4.013576710399762).$$