Let $h(t)$ be a smooth curve in a matrix Lie group G, with $h(0)=e$. Let $v \in T_e G$. Then it holds that
$$\left.\frac{d}{dt}\left(Ad_{h(t)}(v)\right)\right|_{t=0} = ad_{\left.\frac{d}{dt} h(t) \right|_{t=0}}(v).$$
... I have been trying to figure out if this holds in a general Lie group. Any hints would be greatly appreciated.
Yes, it holds in general.
Hint: $\operatorname{ad}=\operatorname{Ad}'(0)$ + chain rule.