Let $a,b,c\in[0,1]$ and such that $a\leq b\leq c$. Find the maximum of $$ f(a,b,c)=c(\sqrt{a}+\sqrt{b})-(a+b)\sqrt{c} $$ This is a problem in the contest for talented students. I have tried but it is extremely difficult.
Attempt Observe that $f(a,b,c)\leq \sqrt{a}+\sqrt{b}-a-b$. Indeed, the latter inequality is equivalent to $$ (1-\sqrt{c})((\sqrt{a}+\sqrt{b})(1-\sqrt{c}-a-b))\geq 0. $$
Set $x = \sqrt a, y = \sqrt b, z = \sqrt c$. Then $0 \le x \le y \le z \le 1$, and $$ f(a, b, c) = z^2(x+y) - (x^2 + y^2) z = z x (z-x) + z y (z - y) \, . $$ Applying the inequality of arithmetic and geometric means we get that $$ f(a, b, c) \le z \left( \frac{x + (z-x)}{2}\right)^2 + z \left( \frac{y + (z-y)}{2}\right)^2 = \frac{z^3 }{2} \le \frac 12. $$ Equality holds for $(x, y, z) = (\frac 12, \frac 12, 1)$, that is for $(a, b, c) = (\frac 14, \frac 14, 1)$.