I can visualize the exponential function with the graph $y = e^x$, but I can do that for almost any function.
In addition to its graph, the function $f(x) = x^n$ can be visualized as the volume of a box with sides of length $x$ in n-dimensional space, and the trigonometric functions can be interpreted as side lengths of certain right triangles.
Is there a similar geometric interpretation of the exponential function?
There's a geometric interpretation of the natural log. From the definition
$$ \log x = \int_1^x {1 \over t} \: dt $$
we see that the area between the "standard" hyperbola $xy = 1$ and the horizontal axis between $1$ and $x$ is $\log x$.
So, turning this around, the line $x = e^t$ is the vertical line such that the area between $x = 1$ and $x = e^t$, between this hyperbola and the $x$-axis, is $t$.