This limit arose when I wanted to show that $f(z) = \overline{z}$ is not holomorphic.
When I say that $$\lim_{h \rightarrow 0} e^{-2i \cdot \arg(h)} = e^{-2i \cdot \arg(0)} = 1$$
I have shown that $f$ is holomorphic. So I suppose I can't simply plug in $h=0$. Why?
Any branch of the argument function describes the angle between a complex number and the $x$-axis. Hence the argument of $0$ is undefined, and there are points arbitrarily close to the origin for which the argument is any given number (in the range chosen according to the branch cut).
Hence $\lim_{h \to 0} \arg h$ does not exist.