In my textbook, there is a statement as follows:

I don't understand how "linear approximation gives an approximation over an entire interval". I guess that it may have something to do with the fact that we factor in the interval of $x$, $\Delta x$, in the equation of linear approximation. However, I am not crystal clear on what that sentence is referring to.