I have found several questions including this as a step in the explanation, but have not been able to find an explicit explanation of how to take a derivative of a magnitude of a vector.
I am trying to take the derivative d/dt ||r'(t)|| but don't know how to address the magnitude signs.
I will assume that you are working with the euclidian norm and the dot product. Let $v(t)$ be a vector: $$v(t) \cdot v(t)=|v(t)|^2$$ And $$\frac{\mathrm{d}|v(t)|^2}{\mathrm{d}t}=2|v(t)|\frac{\mathrm{d}|v(t)|}{\mathrm{d}t}$$ Which implies that $$\begin{align} \frac{\mathrm{d}|v(t)|}{\mathrm{d}t}&=\frac{1}{2|v(t)|}\frac{\mathrm{d}|v(t)|^2}{\mathrm{d}t}\\ &=\frac{1}{2|v(t)|}\frac{\mathrm{d}(v(t) \cdot v(t))}{\mathrm{d}t}\\ &=\frac{1}{2|v(t)|}\left(v(t) \cdot v'(t)+v'(t) \cdot v(t)\right)\\ &=\frac{1}{2|v(t)|}\left(2v(t) \cdot v'(t)\right)\\ &=\frac{v(t) \cdot v'(t)}{|v(t)|} \end{align}$$