How can one prove that $$ (\log\det\cal A=) \operatorname{Tr} \log \cal{A} = \int_{\epsilon}^\infty \frac{\mathrm{d}s}{s} \operatorname{Tr} e^{-s \mathcal{A}},$$ for a sufficiently well-behaved operator $\cal{A}?$ How mathematically rigorous is the expression?
I'm looking at the $d=2$ Euclidean case, as discussed for $\cal{A}=-\Delta + m^2$ in paragraph 32.2.1 of the book Mirror Symmetry by Vafa et al.
First of all, I think there should be a minus sign in front of $\Delta$ : $A= (- \Delta + m^2)$ so that it is positive.
Assume that $A$ has pure point spectrum as it happens for the operator you wrote in compact manifolds with dimension $n$ (there is a unique self-adjoint extension of the said $A$ when defining the initial domain to be the space of $C^\infty$ functions on that manifold). It is possible to prove that the eigenvalues diverge as fast as pictured by a known asymptotic formula due to Weyl: $$\lim_{j \to +\infty}\lambda_j^{n/2}/j = C_n >0\qquad (1)$$ where eigenvalues are counted taking their (finite) multiplicity into account: $$0 \leq ... \leq \lambda_j \leq \lambda_{j+1} \leq ...\to +\infty$$ So $e^{-tA}$ is trace class because has non-negative eigenvalues $e^{-t\lambda_j}$ with finite multiplicity such that $\sum_j e^{-t\lambda_j} < +\infty$ as you can prove form (1). $$\int_{\epsilon}^\infty \frac{\mathrm{d}s}{s} \operatorname{Tr} e^{-s A} = \int_{\epsilon}^\infty \frac{{d}s}{s}\sum_j e^{-s\lambda_j} = \sum_j \int_{\epsilon}^\infty \frac{{d}s}{s} e^{-s\lambda_j} $$ I have swapped the symbol of integral and that of sum, because, once-again (1) easily implies that the function $(j,s) \mapsto e^{-s\lambda_j}/s$ is (absolutely) integrable in the product measure, so I could exploit Fubini-Tonelli theorem. Since: $$\ln \lambda = \lim_{\epsilon \to 0^+}\left(\int_\epsilon^{+\infty} \frac{e^{-\lambda t}}{t} dt + (\gamma -\ln \epsilon)\right)$$ we can write: $$\int_{\epsilon}^\infty \frac{\mathrm{d}s}{s} \operatorname{Tr} e^{-s A} = \sum_j \ln \lambda_j + \sum_j O(\ln \epsilon)\:.$$ Up to a divergent part one has to renormalize, the found result can be re-written as: $$\int_{0^+}^\infty \frac{\mathrm{d}s}{s} \operatorname{Tr} e^{-s A} = tr \ln A$$ Actually, the point is that $tr\ln A$ is not defined,for $A= (-\Delta +m^2)$ and needs to be regularized.