let $x,y,z$ be real number.if $x+y+z=3$,show that $$x^3y+y^3z+z^3x\le \dfrac{9(63+5\sqrt{105})}{32}$$
and the inequality $=$,then $x=?,y=?,z=?$
I can solve if add $x,y,z\ge 0$,also see: Calculate the maximum value of $x^3y + y^3z + z^3x$ where $x + y + z = 4$ and $x, y, z \ge 0$.
But for real $x,y,z$ I can't solve it


We have \begin{align*} &x^3y + y^3z + z^3 x\\ =\,& \frac{(x + y + z)(x^3 + y^3 + z^3) - (x^4 + y^4 + z^4)}{2} - \frac{x + y + z}{2}(x - y)(y - z)(z - x)\\ =\, & \frac{3(x^3 + y^3 + z^3) - (x^4 + y^4 + z^4)}{2} - \frac{3}{2}(x - y)(y - z)(z - x)\\ \le\, & \frac{3(x^3 + y^3 + z^3) - (x^4 + y^4 + z^4)}{2} + \frac{3}{2}\sqrt{(x - y)^2(y - z)^2(z - x)^2}. \tag{1} \end{align*} It suffices to prove that $$\frac{9(63+5\sqrt{105})}{32} - \frac{3(x^3 + y^3 + z^3) - (x^4 + y^4 + z^4)}{2} \ge \frac{3}{2}\sqrt{(x - y)^2(y - z)^2(z - x)^2}.$$ Note that \begin{align*} &3(x^3 + y^3 + z^3) - (x^4 + y^4 + z^4)\\ =\,& -\frac{1}{64}(8x^2 - 12x - 9)^2 -\frac{1}{64}(8y^2 - 12y - 9)^2 -\frac{1}{64}(8z^2 - 12z - 9)^2\\ &\quad + \frac{27}{8}(x + y + z) + \frac{243}{64}\\ \le\, & \frac{27}{8}\cdot 3 + \frac{243}{64}\\ <\, & 2\cdot \frac{9(63+5\sqrt{105})}{32}. \end{align*} It suffices to prove that \begin{align*} & \left[\frac{9(63+5\sqrt{105})}{32} - \frac{3(x^3 + y^3 + z^3) - (x^4 + y^4 + z^4)}{2}\right]^2\\ \ge\, & \frac{9}{4}(x - y)^2(y - z)^2(z - x)^2. \tag{2} \end{align*}
Let $p = x + y + z = 3$, $q = xy + yz + zx$ and $r = xyz$.
Denote $Q = \frac{9(63+5\sqrt{105})}{32}$. (2) is written as $$\left(Q - \frac92\,q + \frac32\,r + {q}^{2}\right)^2 \ge \frac{9}{4}(-4\,{q}^{3}+9\,{q}^{2}+54\,qr-27\,{r}^{2}-108\,r)$$ or $$63\,{r}^{2} + 3\, \left(Q + {q}^{2} - 45\,q + 81 \right) r + {Q}^{2}+ \left( 2 \,{q}^{2}-9\,q \right) Q+{q}^{4} \ge 0 $$ or \begin{align*} &\frac{1}{28}\, \left( {q}^{2}+Q-45\,q+42\,r+81 \right) ^{2} + \,{\frac { 384}{117\,\sqrt {105}+721}}\left( 8\,q+9 +3\,\sqrt {105} \right) ^{2}\\ &\quad + {\frac {3 }{114688}}\, \left( 24\,q+13-9\,\sqrt {105} \right) ^{2} \left( 8\,q+9+3\,\sqrt {105} \right) ^{2} \ge 0 \end{align*} which is clearly true.
We are done.
Remarks:
Actually, $\frac{9(63+5\sqrt{105})}{32}$ is the maximum.
Let $x_0 > y_0 > z_0$ be the three real roots of the cubic $${u}^{3}-3\,{u}^{2}+ \left( -{\frac {9}{8}}-\frac38\,\sqrt {105} \right) u+ {\frac {63}{16}}+{\frac {51}{112}}\,\sqrt {105} = 0.$$
Let $p_0 = x_0 + y_0 + z_0, q_0 = x_0y_0 + y_0z_0 + z_0x_0, r_0 = x_0y_0z_0$. Then $$p_0 = 3, ~ q_0 = -{\frac {9}{8}}-\frac38\,\sqrt {105}, ~ r_0 = - {\frac {63}{16}} - {\frac {51}{112}}\,\sqrt {105}.$$
We have (see (1)) \begin{align*} &x_0^3y_0 + y_0^3z_0 + z_0^3 x_0\\ =\, & \frac{3(x_0^3 + y_0^3 + z_0^3) - (x_0^4 + y_0^4 + z_0^4)}{2} + \frac{3}{2}\sqrt{(x_0 - y_0)^2(y_0 - z_0)^2(z_0 - x_0)^2}\\ =\, & \frac{9}{2}q_0 - \frac{3}{2}r_0 - q_0^2 + \frac{3}{2}\sqrt{-4\,q_0^{3} + 9\,q_0^{2} + 54\,q_0 r_0 - 27\, r_0^{2}-108\,r_0}\\ =\, & \frac{9(63+5\sqrt{105})}{32}. \end{align*}