The function $f(x) = \sin(x)/x$ is Riemann Integrable from $0$ to $\infty$, but it is not Lebesgue Integrable on that same interval. (Note, it is not absolutely Riemann Integrable.)
Why is it we restrict our definition of Lebesgue Integrability to absolutely integrable? Wouldn't it be better to extend our definition to include ALL cases where Riemann Integrability holds, and use the current definition as a corollary for when the improper integral is absolutely integrable?
You could just as well ask the opposite question: why do we define Riemann integration in such a way that an integral can be convergent without being absolutely convergent? The definition of each type of integral "is what it is," and the way the Lebesgue definition is defined there is no need for improper integrals like in Riemann integration.
We could simulate an improper integral with Lebesgue integration by taking a limit of Lebesgue integrals over bounded regions. But that's not something that's usually of interest in the Lebesgue theory.
The things that are of interest are convergence theorems like the dominated convergence theorem.
In that theorem, the dominating function $g$ needs to be absolutely integrable. Your example, in fact, can be modified to give a counterexample to this statement:
The actual theorem requires $\int |g|$ to be finite. Since that is the sort of condition that we work with most of the time, we use the word "integrable" for it to save space. We can still recapture improper integrals if we have to, but they're rarely of interest in the context of Lebesgue integration, so we don't want to spend a good word like "integrable" on them.