Please, help me with prove the following:
Prove gradient composition rule for the function f(x) = h(g(x))
h: R $\rightarrow$ R, g: $R^n$ $\rightarrow$ R
$\triangledown_x$ f(x) = h'(g(x))$\triangledown_x$g(x)
using vector notations. I know how to do it through limits, but I have no idea how to solve it using vectors.
You can derive this by considering one component at a time.
Let's illustrate this with $n=2$, say with $\mathbf{x}=[x,y]$. Then $\nabla_\mathbf{x}$ becomes $\left[\frac{\partial}{\partial x}, \frac{\partial}{\partial y}\right]$.
Now by the scalar (i.e. 'normal') chain rule, treating y as a constant, $$\frac{\partial f}{\partial x}(x,y) = h'(g(x,y)) \frac{\partial g}{\partial x}(x,y)$$ and treating x as a constant, $$\frac{\partial f}{\partial y}(x,y) = h'(g(x,y)) \frac{\partial g}{\partial y}(x,y)$$