Let $f:=\cos(x)$ I'm asked to find for which values of $x$ we can be sure the 4th degree Taylor polynomial will give an error lesser than $\frac{1}{1000}$.
Now, $\cos(x)=1-\frac{x^2}{2}+\frac{x^4}{24}+o(x^4)$
Taylor's 4th degree remainder is then $R=\frac{f^{(5)}(\cos(\theta))}{5!}x^5=\frac{-\sin(\theta)}{5!}x^5$
Since I'm only asked about the error, I can get rid of the sign, and can do the following boundering:
$|R|\leq|\frac{1}{5!}x^5|\leq\frac{1}{1000}$
Since that is strictly increasing, its easy to solve that last inequation, by doing $\frac{1}{120}x^5=\frac{1}{1000}\longrightarrow x=\sqrt[5]{\frac{120}{1000}}\approx0.65$
Which ends up giving $|R|\leq\frac{1}{1000}\forall x:|x|\leq\sqrt[5]{\frac{120}{1000}}(\approx0.65)$
Now, I thought this was an already correct solution, but to my surprise, I checked plotted both the function and its Taylor polynomial, and the error bound that produces below $0.65$ is not only lesser than $\frac{1}{1000}$, but actually lesser than $\frac{1}{10000}$
e.g: $$\cos(0.65)=0.796187...$$ $$taylor(cos(0.65))=0.796083...$$
Which means it is overly precise, what is going on here, I'm asuming it must be some arithmetic mistake I made somewhere, but I can't find it and its driving me crazy.
You made us of $|\sin\theta|\le 1$ in your derivation, which is a very conservative estimate and fine. Once you notice that in fact $|\sin\theta|\le|\theta|\le |x|$, you can try to find the bounds for $x$ from $\left|\frac{x^6}{5!}\right|<\frac1{1000}$, which will allow you to go up to $0.7023\ldots$ instead of just $0.65$.
Still, the fact that Taylor guarantees you an error $<\frac1{1000}$ does not exclude the possibility that the error is indeed much smaller "by chance".