I am searching for any reference that has a mathematical (and/or theoretical physics) rigorious approach to key principles in deep learning.
While most books that I have came across with are heavily focused on computational simulation and designing artificial neural networks, many concepts of deep learning revolve around linear algebra, multivariable calculus, informal probability theory, and a special interest in neural networks and I would hope someone can recommend a reference that tackles deep learning rigorously