I can see this is true for the sum of two roots of unity with some basic trigonometry (the resulting argument is the half the sum of the original arguments, and so must also be a rational multiple of Pi) but trying to extend this method to the sum of more than two doesn't seem to work.
Is there some other way of showing this? It seems related to this question: Sums of roots of unity but I'm not sure if that can be extended to this.
I've answered my own question! I hope that's okay.
I found a counterexample using trig. The sum of the three roots of unity with arguments $\frac{11}{6} \pi, \frac{1}{3} \pi, \frac{1}{3} \pi$ has argument $\arctan(\frac{1}{3}) + \frac{1}{12} \pi$.
By this answer, this cannot be a rational multiple of Pi.