let $f(x)$ be rational non constant polynomial and $f\circ f(x)=3f(x)^4-1$ then find the $f(x)$ .
My Try :
$$f(f(x))=3f(x)^4-1$$
Let $f(x)=ax^n+g(x)$ so :
$$a(ax^n+g(x))^n+g(ax^n+g(x))=3(ax^n+g(x))^4-1$$
$$a^2x^{n^2}+h(x)+k(x)=3ax^{4n}+l(x)-1$$
$$3ax^{4n}-a^2x^{n^2}-1=h(x)+k(x)-l(x)$$
Now what ?
The highest degree terms on each side of what you have are:
$a_n^{n+1}x^{n^2} = 3a_n^4x^{4n}$
$n^2 = 4n\\ n = 4\\ a_4^5 = 3a_4^4\\ a_4 = 3$
But, there is a more direct approach.
$f(f(x)) = 3(f(x))^4 - 1$
Replace the $f(x)$ with $u$ everywhere we see it.
$f(u) = 3u^4 - 1$