The exponential map goes from the tangent space to the manifold, and the log map goes back.
In reading, however, I get the impression that people use the "exponential map" as a term for the overall correspondence, or for travel in either direction. For example, people rarely say "using the log map".
Is this impression correct?
Yes. I would never talk about the "log map." I do however at times refer to "the inverse of the exponential map'' or "the inverse exponential map."
Moreover, I have never heard a professional differential geometer talk about the "log map."