Here is a list of some applications of the exponential function.
1) The exponential mapping in Lie theory.
I put this first because my intuition tells me that this must be the most fundamental, or deep, way of thinking about the exponential function. I have often been misled by my intuition however, and the main reason I feel strongly about this is because of how fundamental I consider Lie theory to be.
2) Fourier Series
3) Roots of Unity
4) Gaussian Distribution
5) Boltzmann Distribution
There are certainly other applications, but it always kind of bothered me that I couldn't use symmetry methods to see how (all of) these applications are related. Is it possible that there is no way to do this, i.e. that it's just a happy accident that the exponential function has these applications and it is unrelated to any continuous symmetries?
The most important traits of the exponential function that make $e^x$ occur in that much applications are
a) Euler's identity $e^{i\pi} + 1 = 0$
and its implications for the definition of complex trigonimetric functions, i.e.
$$e^{i \cdot x} = \cos x + i \sin x$$
(like Fourier transformation, unit roots)
b) the fact that $\frac{d}{dx}e^x = e^x$
which lets $e^x$ naturally occur in many solutions of differential equations, which are often the most basic formulation of natural laws (growth/decay, gaussian distribution).