Find the coefficient of $x^2$ in the expansion of $(4-x^2)[(1+2x+3x^2)^6+(1+4x^3)^5]$
I noticed that since we only care about the coefficient of $x^2$, only the coefficients of $x^2$ inside the square brackets, as well as the constant terms, will matter. From there I am stuck when it comes to expanding $(1+2x+3x^2)^6$ as I can't see an easy way to use the binomial theorem (for example by factorising $1+2x+3x^2$, which I can't do as there are no real roots). Is there a way to find the coefficient of $x^2$ in this expansion (specifically $(3x^2+2x+6)^6$ as I can get the answer from there)?
Yeah, you have the right ideas :) $~$ This answer is the same as gt69's but packaged slightly differently:
Writing it out longform,
$$(1+2x+3x^2)^6 = (1+2x+3x^2)(1+2x+3x^2)\cdots(1+2x+3x^2).$$
There are only two ways to obtain an $x^2$ term:
The reason that binomial coefficients show up is that, for instance, $\binom 6 2$ tells you how many different ways you can pick two of the six factors.
So the $x^2$-term on the square-bracket part of the expression is $\binom 6 2 4x^2 + \binom 6 1 3x^2$, and it seems like from there you're on track for solving the rest of the problem.