This question was inspired by the post: " Is there a solid reason why some people assume the fundamental theorem of calculus should still hold for divergent integrals with improper bounds? " (and the follow-up discussion). Long story short, the OP was using some technique to "regularize" infinite integrals (and claims, for example, that $\int_2^{\infty}\frac{dx}{x}$ has a "regularized value" of $-\log 2$) - and then complaining that whatever regularization they were using did not play well with the rules for change of variable in an integral.
So... What is the "regularization" of an infinite integral? Are there multiple ways to do it, or do all of them boil down to the same thing whenever they "work"? Is there a preferred way of doing it? What generalizations of this notion have been used/studied/are practical? Is it a topic of active research? What are known unsolved problems related to it?
(Of course, I don't expect all those questions to be answered here, I am more after some sort of reference that would possibly be understandable with basic knowledge of real and complex analysis and Lebesgue integration, or perhaps slightly more than that. Ideally an article of the type "Everything you've always wanted to know about regularization but were afraid to ask...")



Basic answer :There is no such thing as regularization of an integral. Either it is convergent, or it makes no sense. The examples in the cited post are just another example of manipulations involving infinity that lead to absurd result (hence this should not be done).
Longer answer : -In courses on complex analysis you have integrals with (complex) parameters that define holomorphic functions and can be extended on a larger set than the set where the integral is convergent. See for example the holomorphic extension of the Gamma function, this is in any book on complex analysis.
The next answers are well beyond undergrad level.
-Physicists often use the notion of renormalization, which consists in removing the divergent part of the integral of some physical quantity, unfortunately I never really understood what part of it was rigorous, and what part was just cooking.
-To some extent, the work of Martin Hairer (Fields medalist 2014) is also centered on renormalization issues for stochastic partial differential equations. I do not know much about it, but I can tell that it requires graduate level knowledge in probabilities to understand the issues. Survey paper https://arxiv.org/pdf/1803.03044.pdf