I was under the impression that the $dx$ in $\int f(x) dx$ is called the differential and represents an infinitesimal change in $x$. However, at the bottom of p. 264 in Spivak's Calculus (4th ed.), the author writes
"The symbol $dx$ has no meaning in isolation, any more than the symbol $x \rightarrow$ has any meaning; except in the context $\lim\limits_{x \rightarrow a} f(x)$."
He also states on the next page that for $\int x^2 dx$,
"The entire symbol $x^2 dx$ may be regarded as an abbreviation for: the function $f$ such that $f(x) = x^2$ for all $x$."
Upon looking at the appendix, there are no mentions of the word "differential" in the book. However, he makes use of them later in the book while describing the integral substitution formula using the equations \begin{equation} \begin{split} u &= g(x),\\ du &= g'(x)dx \end{split} \end{equation} and \begin{equation} \begin{split} x &= g^{-1}(u)\\ dx &= (g^{-1})'(u)du. \end{split} \end{equation}
Is anyone familiar with the reasoning behind this seemingly deliberate omission?
So, formally you can't really speak of "infinitely small" quantities (unless you're gonna talk about the hyperreal numbers, but that's a whole different story). This idea does carry the intuition, and before calculus was set on firm footing this was how people thought about it.
When Spivak talks about integration by substitution, the steps you mention serve merely as notational shorthand, and as everything is being done formally, there is no reference made to infinitesimal changes in quantity. It's fine right now to just write $\int_a^b f$, though it is convenient and later on it will actually become important (specifying which variable/measure you integrate against, and later differential forms will give actual meaning to the $dx$ business).