I didn't see this question in here but it was asked in quora and it was interesting to me that no one had any satisfying answers. some people suggested that it's because exponentiation describes the solutions to some differential equations. but isn't that part of the convenience? differential equations are talking about differences that naturally* occur till exponentiation this is why they are related. why arithmetic in our world reduces to exponentiation? why everything (well most of it) conveniently packs up till exponentiation?
*: exponentiation provides solutions because rates of change in nature and the practical numbers are conveniently packed in hyperoperations with n<4.
The closest I have ever found is Feynman Path Integral with the integration step removed.