Alright, so I was messing around with the linear approximation for a function; I wanted to see if I could get the formula for the 2nd degree approximation from it. I went about it like this:
$$ f(x + \Delta x) \approx f(x) + f'(x) \Delta x $$ $$ \Rightarrow f'(x + \Delta x) \approx f'(x) + f''(x) \Delta x $$ $$ \frac{f(x + 2\Delta x)-f(x + \Delta x)}{\Delta x} \approx f'(x) + f''(x)\Delta x $$ $$ f(x + 2\Delta x) \approx f(x + \Delta x) + f'(x)\Delta x + f''(x)\Delta x^2 $$ $$ f(x + 2\Delta x) \approx \left[f(x) + f'(x)\Delta x \right] + f'(x)\Delta x + f''(x)\Delta x^2 $$ $$ f(x + 2\Delta x) \approx f(x) + 2f'(x)\Delta x + f''(x)\Delta x^2 $$
Then I do the replacement: $ h = 2\Delta x $:
$$ f(x + h) \approx f(x) + 2f'(x)\frac{h}{2} + f''(x)\left(\frac{h}{2}\right)^2 $$ $$ f(x + h) \approx f(x) + f'(x)\cdot h + f''(x) \cdot \frac{h^2}{4} $$
Which just seems outright wrong. Shouldn't I be getting the 2nd degree Taylor polynomial? I guess one of the assumptions I made was incorrect?
Anyway, thanks for reading through if you did. Any helpful pointer would be very much appreciated.
In the approximation
$$f(x + 2\Delta x) \approx f(x + \Delta x) + f'(x)\Delta x + f''(x)\Delta x^2$$
you are considering terms up to the second order. Thus, the problem appears when you approach
$$f(x + \Delta x) \approx f(x) + f'(x) \Delta x.$$ This is correct, but it is an approximation up to first order. So, when you put together both approximations there is a missing term. If you approach
$$f(x + \Delta x) \approx f(x) + f'(x) \Delta x+\frac{f''(x)}{2}(\Delta x)^2$$ the problem dissapears. This expression is exactly what you were looking for. In conclusion, the problem is the use of approximations up to different order.