I am in discussion with someone online on the subject of the Dirac delta function. This other person wants to say:
$$\delta (x) = \begin{cases} 0 & : x \ne 0 \\ \infty & : x = 0 \end{cases}$$
and wants to justify it by saying:
We have that:
$$\delta (x) = \lim_{\epsilon \mathop \to 0} F_\epsilon (x)$$
where:
$$F_\epsilon (x) = \begin {cases} 0 & : x < -\epsilon \\ \dfrac 1 {2 \epsilon} & : -\epsilon \le x \le \epsilon \\ 0 & : x > \epsilon \end {cases}$$
Therefore:
$$\delta (0) = \lim_{\epsilon \mathop \to 0} F_\epsilon (0) = \dfrac 1 {2 \times 0} = \infty$$
and:
$$ \delta {x \ne 0} = \lim_{\epsilon \mathop \to 0} F_\epsilon (x \ne 0) = 0$$
Therefore:
$$\delta (x) = \begin{cases} 0 & : x \ne 0 \\ \infty & : x = 0 \end{cases}$$
This comes across as iffy to me. I don't trust $\delta (0) = \infty$ as it is not well-defined exactly what $\infty$ actually means in this context, whereas in fact $\delta$ is precisely defined by means of the limit definition as given above.
I am also seriously unsure about that $\dfrac 1 {2 \times 0}$ in the middle of the exposition, which is at best meaningless and at worst a blasphemous lie.
However, when I consult a number of mathematical works on my shelves and online, there are many of them which give that above definition quite casually, along the lines "As an obvious consequence of the definition: $\delta (0) = \infty$" or some such. Other works heavily italicise the warning that $\delta$ is not a function, and $\delta (0)$ is undefined.
What is the current mode of thought here? I am trying to craft a set of webpages which are mathematically rigorous, but coworkers on the same site are of the mind "It doesn't really matter, we all sort of know what we mean, and hey, $\delta (0) = \infty$ looks really cool!"
When questioning the matter, he is prepared to compromise and say: $\delta (0) \to \infty$ as $x \to 0$, or even:
$$\delta (x) = \begin{cases} 0 & : x \ne 0 \\ \to \infty & : x = 0 \end{cases}$$
I am insufficiently mathematically sophisticated as to be able to explain why I hate this approach, but I seriously dislike bandying the $\infty$ sign around, when (once we get past the obvious intuitive meaning we learn in elementary school) we really don't understand what it means.
EDIT:
As requested, I have actually dug up one of my texts which defines the delta function as the limit of the rectangle function as its width goes to zero, as follows. It comes from I.N. Sneddon's "Special Functions of Mathematical Physics and Chemistry", appendix.
If we consider the function $$\delta_a (x) = \begin {cases} 0 & : |x| > a \\ \dfrac 1 {2 a} & : |x| < a \end {cases}$$ then it is readily shown that $$\int_{-\infty}^\infty \delta_a(x) d x = 1.$$
...
We now define $$\delta(x) = \lim_{a \to 0} \delta_a (x).$$ Letting $a$ tend to zero in equations [above] we see that $\delta(x)$ satisfies the relations $\delta(x) = 0$, if $x = 0$ $$\int_{-\infty}^\infty \delta (x) d x = 1.$$
No. Defining $\delta(0)=\infty$ is not at all right, because it has to equal $\infty$ in just the "right way". You can define this as a distribution, which ignoring all technicalities, just means that it is an "evaluation linear map". I.e, given an appropriate vector space $V$ of functions $\Bbb{R}^n\to\Bbb{C}$, we consider $\delta_a:V\to\Bbb{C}$ defined as $\delta_a(f):= f(a)$. In other words, $\delta_a$ is an object which eats a function as input and spits out the value of the function a the point $a$.
Afterall, this is literally what we want it to do: when we write $\int_{\Bbb{R}^n}\delta_a(x)f(x)\,dx=\int_{\Bbb{R}^n}\delta(x-a)f(x)\,dx=f(a)$, we literally mean that $\delta_a$ is an object such that whenever we plug in a function $f$, we get out its value at $a$. Of course, writing it in this way inside an integral is a priori just nonsense, because there is no function $\delta_a:\Bbb{R}^n\to\Bbb{C}$ for which the above equality can hold true.
So, in summary, the dirac delta is a function, but it's just that the domain of the dirac delta is a space $V$ of functions, and the target space for $\delta_a$ is $\Bbb{C}$. In short, it is the "evaluation at $a$ map".
As a side remark: the dirac delta is not in any way magical/esoterical once you think of it as an evaluation map. The concept of a function as being a mapping from one set to another set is (from our luxurious perspective of having hindsight) a completely standard concept. So, in this regard the dirac delta is simply a function/mapping. The only difference is that the domain is a space of functions.
Furthermore, the concept of evaluation maps is a very basic concept in linear algebra (e.g., if you study the isomorphism between a finite-dimensional vector space and its double dual you'll see exactly what I'm talking about).
Now, the "difficulty" which comes with this is the question of "how to do calculus with these new types of objects". What I mean is in the ordinary setting of discussing functions $f:\Bbb{R}\to\Bbb{R}$, we have a notion of convergence/limits (i.e a topology), we have a notion of derivative (the study of differential calculus), and we have the notion of anti-derivatives/finding primitives etc. Extending these ideas to the more general setting is where the heart of the matter lies, and to fully appreciate that one should study more closely Laurent Schwartz's theory of distributions.