Let $S$ be a finite generating set of a finitely generated group $G$. Then the set $S'$ of $[a,b]$ for $a,b \in S$ normally generates $G'$, i.e., any element of $G'$ is a product of conjugates of commutators of generators. Indeed, denoting the normal closure of $S'$ by $\langle \langle S' \rangle \rangle$ we have that $G/\langle \langle S' \rangle \rangle$ is abelian (because the generators commute), so $G' \subset \langle \langle S' \rangle \rangle$, and that $S' \subset G'$. Hence, $G' = \langle \langle S' \rangle \rangle$ is finitely normally generated. (Notice that the word "normally" is important since, e.g., $F_2'$ is not finitely generated, where $F_2$ is the free group on two generators.) See also this answer explaining what I just explained.
Does this generalize to higher order terms in the derived series? More concretely: Let $G$ be a finitely generated group. Is the $k$-th term of the derived series $G^{(k)}$ finitely normally generated in $G$ for $k \geq 2$?
My suspicion is that the group $F_2/F_2''$ is not finitely presented, which would answer my question in the negative.
Let $G$ be the group defined by the presentation $$\langle x,\, y_i\,(i \in {\mathbb Z}),\,z_i\,(i > 0) \mid y_i^2=1,\,x^{-1}y_ix=y_{i+1}\, (i \in {\mathbb Z}),\,[y_i,y_j] = z_{|i-j|}\,(i\ne j),\,z_i\ {\rm central}\,\rangle.$$ Note that $G = \langle x,y_1 \rangle$ is finitely generated.
Let $Z = \langle z_i \,(i >0) \rangle$. Then $Z =Z(G)$, and $G/Z$ is isomorphic to the Lamplighter Group.
Now $G^{(1)} = \langle y_iy_{i+1}\,(i \in {\mathbb Z}),\,z_i\, (i>0)\rangle$ and $G^{(2)}$ is an infinitely generated subgroup of $Z$. If we let $C$ be a complement of $G^{(2)}$ in $Z$ and define $\bar{G} = G/C$, then $\bar{G}$ is finitely generated and $\bar{G}^{(2)}$ is not finite normally generated, because $\bar{G}^{(2)}$ is an infinitely generated central subgroup.