In the epsilon-delta definition of a limit it says $0 < |x - a| < \delta$ must exist, i.e. the distance between $x$ and $a$ must be positive.
And then this leads to the implication that $|f(x) - L| < \epsilon$ holds where $\epsilon > 0$.
But why isn't it $0 < |f(x) - L| < \epsilon$? I thought limits were all about getting closer to a $y$ as you narrow in on an $x$. This definition implies that it is possible to bring $x$ near $a$ and yet somehow the limit $L$ is can possibly equal $f(x)$ as opposed to just getting closer and closer to it.
The definition intends to exclude the case $x=a$, so that a limit can be defined even if $f$ is undefined at $a$, as in say the definition of the derivative. In the case that the limit exists, it would be logically equivalent to replace $f$ (perhaps undefined at $a$) by some function $g$ which extends $f$ and is defined to have $g(a)=L$. But this is a bit backwards, so I think people avoid doing it.
On the other hand, it is completely permissible to have $f(x)=L$ even if $x$ is not equal to $a$. Think of the function $$f(x) = x\sin(1/x)$$ As $x \to 0$, no matter how small you choose $\delta$ there is an $x$ such that $0<|x|<\delta$ and $f(\delta)=0$. If you were to insist that $0<|f(x)|<\varepsilon$, then it would be false that $$\lim_{x \to 0} f(x) = 0$$ which is probably undesirable!
Said more formally: Say $f(x) \to L$ strongly if $$\forall \varepsilon >0 \quad \exists \delta>0 : 0 \le |x-a| <\delta \implies |f(x) - L| < \varepsilon$$ In other words, we change $0<|x-a|< \delta$ to just $|x-a|< \delta$. Then it is the case that if $f(x) \to L$ strongly, then $f(x) \to L$ in the usual sense. Moreover, if $f(x) \to L$ in the usual sense but $f$ doesn't tend to $L$ strongly, then the function $$g(x) = \cases{L \quad \quad x=a\\f(x) \quad \text{otherwise}}$$ tends to $L$ both strongly and in the usual sense. So the definitions are not too different.
On the other hand, say $f(x) \to L$ too strongly if: $$\forall \varepsilon >0 \quad \exists \delta >0 : 0<|x-a|<\delta \implies 0 < |f(x)-L| < \varepsilon$$ Now clearly, if $f(x) \to L$ too strongly then $f(x) \to L$ in the usual sense. But as we point out above, we exclude functions from the definition that we would prefer not to exclude.