I wonder to what extent one can support the analogy that primitive closed geodesics are the prime numbers of Riemannian manifolds? ("Primitive": traced once, as opposed to $m$-fold for $m \ge 2$.) In fact, primitive closed geodesics are also known as "prime geodesics," and there is a "prime geodesics theorem" whose count of "primitive conjugacy classes" is analogous to the prime number theorem.
But I am especially interested in whether the analogy can be supported by characteristics of geodesics and of prime numbers that could be understood by those who are neither experts in number theory nor in Riemannian geometry. I once rashly claimed to students in a class that "closed geodesics are the prime numbers of Riemannian manifolds," but in fact I couldn't flesh out the analogy in much detail.
There is work in this direction by Alexander Reznikov and in a different vein by Christopher Deninger, but perhaps the most accessible analogy is in terms of the Selberg trace formula. The role closed geodesics play in determining the spectrum of the Laplacian is parallel to the role that prime numbers play in determining the Riemann zeta function.