I feel like I have some fundamental misunderstanding and I'm not really sure how to phrase this question, but here's a first attempt. In Child's Concrete Introduction to Higher Algebra (ISBN: 978-0387745275), the author uses $\mathbb{F}_p$ and $\mathbb{Z}/p\mathbb{Z}$ interchangeably (especially when talking about polynomials with coefficients in some field $\mathbb{F}_p$). I understand that if $p$ is prime, then $\mathbb{Z}/p\mathbb{Z}$ is a field, but why is correct to say something like this:
Let $f(x),g(x) \in \mathbb{F}_3[x]$ and $f(x)=3x^2 + 2$. If $g(x)=2$, then $f(x)=g(x)$. Basically, why can I apply modulo...aren't there fields that aren't the set of congruence classes modulo $p$ (which is how I understand $\mathbb{Z}/p\mathbb{Z}$)? Is this some fundamental property of finite fields that I haven't read about yet?
As Andreas and Steven said, there is only one field which $p$ elements, for $p$ prime, up to isomorphisms. This fact is part of a more general result:
The symbol $\mathbb{F}_{p^n}$ denotes the field with $p^n$ elements. It is important to notice that:
Hence you are allowed to think about $\mathbb{Z}/p\mathbb{Z}$ when you read $\mathbb{F}_p$, but if $n>1$ then the field $\mathbb{F}_{p^n}$ cannot be identified with the set of congruence classes modulo $p^n$.
EDIT: my first answer of the following question was not completely correct.
The answer to "aren't there fields that aren't the set of congruence classes modulo $p$?" is "yes, every finite field is (isomorphic to) a set of congruence classes". As Pedro Tamaroff pointed out in his comments, every finite field can be realized as a quotient: $\mathbb{F}_{p^n}$ is isomorphic to $$ \frac{\mathbb{Z}_p[X]}{(f_n)}$$ where $\mathbb{Z}_p$ is the field $\mathbb{Z}/p\mathbb{Z}$ and $f_n$ is an irreducible polynomial of degree $n$ with coefficients in $\mathbb{Z}/p\mathbb{Z}$. Indeed, the above quotient is a field which is an extension of $\mathbb{Z}_p$ of degree $n$, so it has got $p^n$ elements.
However, it is true that there are finite fields that cannot be realized as sets of integer congruence classes.