
Start by assuming that function curves are made of an infinite amount of lines (i.e. look at the image above but instead of approximating it using a finite number of lines, use infinite lines). This intuition is supported by the arc length formula (integral of infinite "line approximations").
Let's call the point at the top ("the highest point") point $x$. Refer to the $n^{th}$ point before that as $x-n$ and the $n^{th}$ point after that as $x+n$. I want to calculate the derivative at point $x$. In other words I want to calculate the slope of the line connecting point $x$ and $x+1$.
I can start be drawing a secant line from point $x$ to $x+n$ and using the slope to approximate the derivative. As $n$ approaches $1$, you get better approximations of the derivative. As $n=1$ you exactly have the derivative.
Now draw a secant line from point $x$ to $x-n$. As n approaches 1 you get infinitely better approximations of the slope of the line between $x$ and $x-1$, but not $x$ and $x+1$. No matter how close to n=1 you get you will never get the slope of the line that connects $x$ and $x+1$ (which is what the derivative is: the rate of change of the function between a point and the next infinitesimal point).
So why is the derivative the limit:
$$\lim _{h \rightarrow 0} \frac{f(x+h) - f(x)}{h}$$
instead of:
$$\lim _{h \rightarrow 0^+} \frac{f(x+h) - f(x)}{h}$$
Since using the above intuition shows that the left hand limit doesn't give you the slope of the line between $x$ and the next infinitesimal point.


It is an interesting question. Your understanding of the situation is quite good, you are just missing a small element.
Suppose your function is $$f(x) = \left| x \right |$$
Using your technique, the limit from the right, you find that the slope at $x=0$ is simply $1$. But what if you use the same technique starting from the left? You get that the slope at $x=0$ is $-1$. This is a contradiction. You find that the slope at a certain point can be two different things, but this is far off the general definition of the tangeant line and its slope!
In fact, in the case of $f(x) = \left| x \right |$, the derivative at $x=0$ is said to be undefined, and you can easily understand why by taking a look at the graph. But, in some cases, you might only be interested in what is going on with the limit from the right, or maybe with the limit from the left.
Added:
A limit $\lim\limits_{x\rightarrow a} f(a)$ is only defined if $\lim\limits_{x\rightarrow a^+} f(a) = L$ and $\lim\limits_{x\rightarrow a^-} f(a) = L$.