My textbook says that $ (\mathbb{Z}_{m},+,*)$ is a field if and only if m is a prime number.
However, on Wikipedia it says: "Finite fields only exist when the order (size) is a prime power $p^{k}$ (where $p$ is a prime number and $k$ is a positive integer)."
Since 2 is a prime number, this would imply that $ (\mathbb{Z}_{4},+,*)$ is a finite field, since $2^{2} =4$
The same book then demonstrates that $ (\mathbb{Z}_{4},+,*)$ is not a field.
So is $ (\mathbb{Z}_{4},+,*)$ a field or not?
$\mathbb{Z}_4$ is not a field. There exist fields with prime power orders with exponents other than $1$. However, they are not of the form $\mathbb{Z}_m$ for any $m$. Rather, they are obtained from $\mathbb{Z}_p$ by adjoining roots of polynomials.