Suppose you have a Riemannian manifold $(M,g)$ and a point $p\in M$ fixed. Let $v: s\mapsto v(s)$ be a curve in $T_pM$. Now consider the map $f(s):=\exp_p(v(s))$.
Can one get an explicit formula for $f'(s)$? Maybe that is confusing but I thought of something like $f'(s)=d(\exp_p)_{v(s)}(\nabla_sv(s))$, where $\nabla_s$ denotes the covariant derivative.
Formally, $d(\exp_p)_{v(s)}$ is a map from $T_{v(s)}T_pM$ to $T_{\exp_p(v(s))}M$ and one can identify $T_{v(s)}T_pM\cong T_pM$. I would like to know if the formula above is true and how this identification is related to the Levi-Civita-connection on $M$. Thanks for any explanation.
Since $T_pM$ is a vector space, the derivative of $v(s)$ is defined without need to resort to "covariant derivative", so in your formula $\nabla_s v(s)$ can be replaced simply by the derivative $v'(s)$. The formula you wrote down is true by chain rule. In fact, it would be true for any map and not just the exponential map. To define the exponential map, one certainly needs the Levi-Civita connection.