I have a basic question about the dirac $\delta$-function based on the beginning of Chapter 1 of these notes.
The dirac $\delta$-function can be defined heuristically as the function that is $0$ everywhere except as $x = 0$, where it is $\infty$.
But formally, this is not the definition of the functional (since it's not a function). Here is my question:
Since $\delta$(x) is not defined for each $x$, how can we talk about the product $(f(x)-f(0))\delta(x)$? The author says this is identically $0$. Why? If we are using the heuristic definition of $\delta$, then when $x \neq 0$, $\delta(x) = 0$ so the product is $0$, and if $x = 0$, then we get $(f(0) - f(0))\cdot \infty$, but who is to say this is equal to $0$? If $0 \cdot \infty$ always equaled $0$, then under this heuristic definition, we should have $\int \limits_{\Bbb R} \delta(x) \,dx = \int \limits_{\Bbb R - \{0\}} \delta(x) \,dx + \int \limits_{ \{0\} } \delta(x)\,dx = 0 + 0 \cdot \infty = 0$, but this integral is by definition equal to $1$. But even so, what if we aren't using the heuristic definition?
The heuristic statement $\delta(x)(f(x)-f(0))=0$ means that for each test function $f$, the functional $D[f(x)-f(0)]=0$, where $D[\cdot]$ is the Dirac Delta functional.
We write the functional for $D$ formally as
$$D[\cdot]=\int_{-\infty}^{\infty}\delta(x)[\cdot]dx \tag 1$$
But the right-hand side of $(1)$ is not an integral. Rather, it shares many of the same properties with integrals and is therefore useful notation. But it is only notation.
So, for a test function $f(x)$, we have
$$D[f(x)]=f(0)$$
and therefore
$$D[f(x)-f(0)]=f(0)-f(0)=0\tag 2$$
Finally, we interpret $(2)$ formally and write
$$\delta(x)(f(x)-f(0))=0$$
Text books that heuristically discuss the Dirac Delta will often give the curiously nonsensical point-wise definition of $\delta(x)$
$$\delta(x)= \begin{cases} 0,&x\ne 0\\\\ \infty,&x=0 \end{cases} $$
which obviously is meaningless even with the additional condition that $\int_{-\infty}^{\infty}\delta(x)\,dx=1$.
This "hand-waving" description can be made rigorous by defining a family of functions $\delta_n(x)$ with the properties that
$$\lim_{n\to \infty}\delta_n(x)= \begin{cases} 0,&x\ne 0\\\\ \infty,&x=0 \end{cases} $$
and
$$\lim_{n\to \infty}\int_{-\infty}^{\infty}\delta_n(x)\,dx=1 \tag 3$$
One may then write, $\delta(x)\sim \lim_{n\to \infty}\delta_n(x)$ with the interpretation provided by $(3)$. Examples of such families of functions include the pulse function
$$\delta_n(x)= \begin{cases} n/2,&-\frac{1}{n}\le x\le \frac{1}{n}\\\\ 0,&\text{otherwise} \end{cases} $$
and the Gaussian function
$$\delta_n(x)=\frac{n}{\sqrt{\pi}}e^{-n^2x^2}$$
In this answer here, I discussed the regularization used in potential theory for the $\mathscr{R}^3$ Dirac Delta $\delta(\vec r)$. There, the Dirac Delta is written
$$\begin{align} \delta(\vec r)&\sim \lim_{a\to 0}\delta_{a}(\vec r)\\\\ &=\lim_{a\to 0} \frac{3a^2}{4\pi(r^2+a^2)^{5/2}} \end{align}$$
where $\lim_{a\to 0}\int_{\mathscr{R}^3}f(\vec r)\,\delta_{a}(\vec r)\,dV=f(0)$.
And finally in this answer here, I analyze the family of functions $\delta_{\epsilon}(x)=\frac{1}{\sqrt{\pi\,\epsilon}}e^{-\tan^2(x)/\epsilon}$ that describes the "train" of Dirac Deltas
$$\sum_{\ell =-\infty}^{\infty}\delta(x-\ell \pi)\sim \lim_{\epsilon \to 0}\frac{1}{\sqrt{\pi\,\epsilon}}e^{-\tan^2(x)/\epsilon}$$