My instinct tells me the above isn't true, although I am having trouble finding a counterexample.
Hints on where to look for a counterexample would be much appreciated. Hopefully there is some semidirect product which does the trick.
The question arose when I was studying another proof about torsion free groups, and the fact they didn't appeal to this result seems to suggest it isn't true.