Give the Big $O$ estimate of $(n \log n +1)^2 + (\log n +1)(n^2+1)$
Taking big $O$ of the first function (ignoring constant and exponent), ($n\log n + 1)^2$ we get $O (n \log n)$
Taking big $O$ of the second function (ignoring constants), $(\log n + 1) (n^2+1)$ we get $O (n^2 \log n)$.
Taking the max $(n\log n, n^2\log n) = O (n^2\log n)$ <- answer
We can't really ignore the exponent. Expanding the first part, we get: $$ (n\log n + 1)^2 = n^2\log^2 n + 2n\log n + 1 $$ The $n^2\log^2 n$ term dominates all other terms, so we conclude that it is $O(n^2\log^2 n)$.