I was trying to understand why $e^{x}$ is special by finding the derivatives of other exponential functions and comparing the results. So I tried ${\rm f}\left(x\right) = 2^{x}$, but now I'm stuck.
Here's my final step: $\displaystyle{{\rm f}'\left(x\right) = \lim_{h \to 0}{2^{x}\left(2^{h} - 1\right) \over h}}$.
You discovered that \begin{equation*} \frac{d}{dx} 2^x = c 2^x \end{equation*} where $c = \lim_{h \to 0} (2^h - 1)/h$.
But note that $c \neq 1$, which is kind of annoying.
If you had used $e$ instead of $2$, you would have had $c = \lim_{h \to 0} (e^h - 1)/h$, which actually is equal to $1$. In fact, this is one definition of $e$.
So the derivative of $e^x$ is just $e^x$, the same thing you started with -- a beautiful result.