I'm quite confused about the definition of $\Bbb ZG$ modules and $\Bbb ZG$ rings.
- Is the definition of $\Bbb ZG$ module equivalent to "free $\Bbb Z$-module on $G$"?
- Given $G$, are the underlying set of $\Bbb ZG$ module and $\Bbb ZG$ ring exactly the same?
- Given $G$, are the addition operation of $\Bbb ZG$ module and $\Bbb ZG$ ring exactly the same?
- When $G$ is finite, is the below picture(from Dummit and Foote) the definition of $\Bbb ZG$ ring? And is the addition operation defined below also the addition operation of $\Bbb ZG$ module when $G$ is finite?

- Finally, is (iv) in the below picture the standard definition of $\Bbb ZG$ ring when $G$ is infinite? Why does the $x^{-1}$ appear? How to think about it?

Let me try to clarify matters, in the order you addressed them.
$$A^M= \prod_{t \in M} A$$ Then, for arbitrary $u \in A^M$ define the support $\mathrm{Supp}\ u=\{t \in M\ |\ u_t \neq 0_A\}$ and introduce the subset $$A^{(M)}=\{u \in A^M\ |\ \mathrm{Supp}\ u\ \mathrm{finite} \}$$
which is easily seen to be a subgroup of the direct product $A^M$, namely the direct sum of the additive groups $(A, +)_{t \in M}$. At this point you thus already have an internal addition on the set $A^{(M)}$, conferring an abelian group structure.
Furthermore, define the multiplicative operation $\cdot : A^{(M)} \times A^{(M)} \to A^{(M)}$ such that for any $u, v \in A^{(M)}$ and any $t \in M$:
$$(uv)_t=\sum_{r,\ s \in M \\ rs=t} u_rv_s \tag{1}$$
what we would call multiplication by convolution, as it intertwines the internal multiplication of the ring $A$ with that of the monoid $M$.
A routine check will establish that this multiplication on $A^{(M)}$ will in conjunction with the addition described above yield a ring structure on $A^{(M)}$. This is the monoid ring, and from this point on you can denote it by $A[M]$, to highlight the fact that you are considering the entire ring structure on it, and not just the additive group direct sum $A^{(M)}$ (nevertheless, as support sets they are one and the same thing, $A[M]=A^{(M)}$, it is merely a matter of what algebraic structure one is focusing on).
$$\sum_{0 \leqslant k \leqslant n} f_kg_{n-k}$$ (where by $f_k$ I mean the coefficient at degree $k$ in $f$). In other words, you are considering all pairs $(k, l)$ of natural numbers such that $k+l=n$ and for every such pair you are contributing with the term $f_kg_l$ to the sum considered over all such pairs. That is because the one indeterminate polynomial ring $A[X]$ is actually canonically (naturally) isomorphic to the monoid ring $A[\mathbb{N}]$!