Let $G$ be a group and let $G'$ be the derived subgroup, defined as the subgroup generated by the commutators of $G$.
Is there an example of a finite group $G$ where not every element of $G'$ is a commutator? $G'$ is only generated by commutators, but with all of the properties of commutators (ie: what happens under conjugation, exponentation, etc) I can't think of an example.
For a nice source of examples, see
which you can get from JSTOR.
Using GAP I find that the two examples of order 96, which is the minimal possible order, are the groups generated by the following two lists of permutations on $32$ elements.
and
(They have GAP ids $(96, 3)$ and $(96, 203)$ respectively.)
Later: I used the following very simple-minded code to find the groups
This works because I remembered there were examples of order 96. To get the permutation representations I did, for example,