We know that
$$\ln{(1+h)} = h - \frac{h^2}{2} +...$$
What is the method for finding how much we should cap $h$ at, to cap the approximation error of $\ln{(1+h)}=h$ at a certain value, like $10^{-3}$ or something like this? I want to solve this using Taylor remainder theorem.
If you approximate $\ln(1+h)$ to $h$, then Taylor's remainder theorem yields that there exists $t\in(0,h)$ such that $\ln(1+h)=h-\dfrac{1}{(1+t)^2}\dfrac{h^2}{2}$. Then the error $\left\lvert\ln(1+h)-h\right\rvert\le\dfrac{h^2}{2}$, since $\dfrac{1}{(1+t)^2}$ is decreasing. If you want to cap the approximation error at $10^{-3}$, then $\dfrac{h^2}{2}\le 10^{-3}$, and you can do the rest of the calculation.