I occasionally see proofs where the limit definition for $e$ pops up and I don't recognize it for some reason, every time!
$$e = \lim_{n \to \infty} \left( 1 + \frac{1}{n}\right)^n$$
For one thing I don't know why it's defined this way or why this particular number is so important. I know the derivative of $e^x$ is still $e^x$ so there's probably some relation in there (except when I take the derivative of $e$ in Wolfram Alpha it gives me a huge messy log expression, not equal to the original), but how can I better understand what $e$ is so all these various relationships and proofs are more obvious to me?
For instance that limit expression I have no idea how to solve, because the inner part approaches $1$ but the exponent approaches infinity, but the answer is certainly not $1^\infty = 1$.
Why is it defined this way? How do we solve it? How do we use it?
The fundamental reason is that $(e^x)'=e^x$ and that makes it the most "natural" choice of the base. By contrast, $(a^x)'=\log a\,a^x$, and we don't like the $\log a$ factor.
Strictly speaking you can't solve the limit $\lim_{n\to\infty}\left(1+\frac1n\right)^n$ because it is the definition of the constant $e$. As long as you have not defined $e$, you cannot express the value of the limit as it is a not-yet-defined number. (Some other answers here are circular arguments showing that $e=e$.)
[A similar situation is with $\lim_{n\to\infty}\left(\sum_{k=1}^\infty\frac1k-\log n\right)$, which tends to a "new" constant named $\gamma$.]
A convenient way to evaluate it is by turning the definition in the equivalent expression $\sum_{n=0}^\infty \frac1{n!}$, which is a very fast convergent series. This formula can be obtained by expanding $(1+\frac1n)^n$ by means of the binomial theorem and reworking.
It is also useful to know the formula below (easily obtained by the change of variable $nx\leftrightarrow m$):
$$e^x=\lim_{n\to\infty}\left(1+\frac1n\right)^{nx}=\lim_{m\to\infty}\left(1+\frac xm\right)^m.$$
Maybe it helps to remember that it is a $1^\infty$ indeterminate form (hence some connection to exponentials), where $1$ is reached in the simple form $1+\frac1n$ and infinity as just $n$. That's about the simplest indeterminate form $1^\infty$ you can think of.