Suppose $f$ is not irreducible. Since $f(x)=x^4+x+4$ does not have any root in $\mathbb{F}_5$, the only possible factorization can be $f(x)=(x^2+ax+b)(x^2+cx+d)$ for $a,b,c,d \in \mathbb{F}_5$.
Now by comparing the coefficients one gets:
$$1. \,\,a+c \equiv 0 $$ $$2. \,\, b+d+ac \equiv0 $$ $$3. \,\,ad+bc \equiv 1 $$ $$4. \,\,bd \equiv 4 $$
From condition $1$ and $4$, one can find possible values of $a,b,c,d$ and show that none of them simultaneously satisfy $2$ and $3$. But this is a rather long process.
I came across this post here but Rabin's test is even more computationally difficult to do by hand. Is there any other way to tackle this without doing tediously long computations especially if one does not have access to computers?
I will appreciate any suggestions.
Checking whether a polynomial is irreducbile is a lot like checking whether a number is prime. You need to check there are no degree-two factors of your polynomial. There are ten irreducible polynomials of degree 2 (which you can list easily), so you can check divisibility by those.
On the other hand Rabin's test which you mention is not that bad here. Since $f$ is square-free (check $\gcd(f, f')=1$) and has no roots we know $f \mid x^{5^4}-x$, so we just have to check $\gcd(f, x^{5^2}-x) = 1$. Moreover we can compute $x^{5^2}$ modulo $f$ via $x^{5^2} = (x^5)^5$, which makes this easy. Modulo $f$ we have $$x^{5^2} \equiv (-x^2+x)^5 \equiv -x^{10}+x^5 \equiv -(-x^2+x)^2 -x^2+x\equiv 2x^3 + 3x^2 + 2x + 4.$$ Call this $g$ and now check $\gcd(f, g-x) = 1$ by the usual algorithm.