We can write the "polynomial" as follows: $$x^4+x^3+x^2+x+1=\frac{x^5-1}{x-1}.$$ For even $x=2y$, we have that $x^5-1=(2y)^5-1=32y^5-1\equiv1$ mod $5$.
For odd $x=2y+1$, we have that $(2y+1)^5-1\equiv_532y^5\equiv2$ mod $5$.
I find it hard to believe my computations above. I guess this makes me rather clueless. I was hoping there was some way out with Legendre symbols. Any help is appreciated.
Hint: Suppose that $$p\mid x^5-1$$ meaning $$x^5\equiv 1\pmod p.$$ This gives us $\text{ord}_p(x)\mid 5$. Suppose $x\not\equiv 1\pmod p$, meaning $\text{ord}_p(x)=5$. We know that for every $n$ and $x$ coprime to $n$ that $\text{ord}_n(x)\mid \phi(n)$. What does this mean in our scenario? How do we eliminate the case $x\equiv 1\pmod p$?