The definition of a limit I am working with:
Let $f(x)$ be a function defined on an open interval around $a$ (and $f(a)$ need not be defined). We say that the limit of $f(x)$ as $x$ approaches $a$ is $L$, i.e.
$$\lim_{x \to a} f(x) = L$$
if for every $\epsilon > 0$ there exists a $\delta > 0$ such that for all $x$ $$0 < |x - a| < \delta \implies |f(x) - L| < \epsilon$$
- First off, is this definition accurate? I assume open interval just means something of the form $(a, b)$ that doesn't include endpoints, but don't we also need that interval to be continuous? No discontinuities or asymptotes or jumps or shifted points or anything like that? Because in theory we could make $\epsilon > 0$ large enough to where it would cover undefined or discontinuous parts of the function.
For example

If we pick a really big epsilon then we'd be covering an area that has a discontinuity. Or would we say that if the limit exists we should also be able to find a delta so small that it bypasses all the discontinuities once we get close enough to the point we want? I don't know if we need to add anything more to the definition for this to work though.
- I am confused about the usage of "for all". Like do they mean literally for all $x$? As in all $x \in \mathbb{R}$? All $x$ in $(-\infty, \infty)$? Or only the $x$ for which $0 < |x - a| < \delta$ is satisfied? It's not clear to me how "all" is referencing $x$ or how it's typically used.
The definition is correct. Note that making $\epsilon$ larger makes the condition $$0 < |x - a| < \delta \implies |f(x) - L| < \epsilon$$ easier to satisfy. In other words, if you find a $\delta$ that works for some $\epsilon$, it also works for every larger $\epsilon$. So the real content of the definition is that no matter how small $\epsilon$ is, you can still find a $\delta$ that works. In other words, no matter how close you want to force $f(x)$ to be to $L$, you can find a small $\delta$ such that when $x$ is within $\delta$ of $a$, $f(x)$ is that close to $L$.
"For all $x$" literally means "for all $x$". That is, $x$ can be anything, not even necessarily a number! It's not necessary to mention $x$ being a number or to require $0<|x-a|<\delta$ in this part, since if that inequality is not true, then the implication $$0 < |x - a| < \delta \implies |f(x) - L| < \epsilon$$ is vacuously true (a false statement implies anything). In other words, it's saying that no matter what $x$ is, if $x$ happens to be a real number such that $0<|x-a|<\delta$, then $|f(x)-L|<\epsilon$ is true.
(To be clear, for this to make sense, you must interpret $|f(x)-L|<\epsilon$ as being false if $x$ is not a real number in the domain of $f$ and similarly $0 < |x - a| < \delta$ as being false if $x$ is not a real number. That way you can assign a truth value to the implication no matter what $x$ is.)