If $f(x) \in C(-\infty+\infty)$, $\;g(x)=f(x) \int_0^x f(t)\,dt\,$ and $\;g(x)$ is monotone-decreasing in $(-\infty,+\infty),$
Prove:$f(x)\equiv 0$.
It is easy to get $g(0)=0$,and I'm thinking about proving $g(x)\equiv 0$,then $f(x)\equiv 0$ follows.
But I havn't any ideas to prove $g(x)\equiv 0$.
Let
$$F(x) := \int_0^x f(t)\,dt.$$
Then we have
$$g(x) = \frac{d}{dx} \left(\frac{1}{2} F(x)^2\right).$$
Since $g$ is assumed to be monotonically decreasing (non-strictly), we have $g(x) \geqslant 0$ for $x < 0$ and $g(x) \leqslant 0$ for $x > 0$. Hence we have
$$\frac{1}{2} F(x)^2 \leqslant \frac{1}{2} F(0)^2$$
for $x < 0$ as well as for $x > 0$. But since $F(0)= 0$, it follows that $F\equiv 0$. From that, $f \equiv 0$ follows easily.