This question takes place in a general metric space $X$.
Let $x$ be an interior* point of $E \subset X$ iff there exists a deleted neighborhood of $x$ that is contained in $E$.
This is like the normal definition of "interior point", except it uses "deleted neighborhood" instead of "neighborhood", thus allowing a point not in $E$ to be an interior* point of $E$.
My question is: why is this not the standard definition of "interior point"? I see a couple reasons that it would make a more elegant system.
- "Limit point" and "interior* point" are both defined in terms of deleted neighborhoods ($x$ is a limit point of $E$ iff all deleted neighborhoods of $x$ include some point of $E$). This is more symmetrical.
- (Note: I do not yet have a general/categorical notion of duality) "Limit point" and "interior* point" are more adequately dual, for $x$ is a limit point of $E$ iff $x$ is not an interior* point of the complement of $E$, whereas this does not hold for "limit point" and "interior point".
- The dual notions of closure and interior are more symmetrically defined using "interior* point". The closure is defined as the union of $E$ and the set of limit points of $E$, and the interior is defined as the intersection of $E$ and the set of interior* points of $E$. The duality between closure and interior is harder to see with the standard definition of interior as the set of interior points of $E$. Also the proof that the complement of the closure of $E$ is the interior of the complement of $E$ reduces to a few applications of DeMorgan's law.
So why do people use "interior point" and not "interior* point"?
The notions of "interior point" and "limit point", as you point out, are not dual. And if we use interior point to define interior and limit point to define closure, then we've just used two non-dual notions to define two dual notions. This is highly dissatisfying, as you know. Which one should we keep and which one should we modify?
Before you jump to the conclusion that "limit point" is golden and "interior point" is backwater, consider the opposite perspective for a moment.
Let $x$ be a "limit* point" of $E$ if every (non-deleted) neighborhood of $x$ intersects $E$. This is like the definition of "limit point" except that it uses "neighborhood" instead of "deleted neighborhood", thus allowing all points in $E$ to be limit* points of $E$.
Three reasons why limit* points are more elegant than limit points: Now limit* points and interior points are both defined in terms of neighborhoods, which is more symmetrical. Limit* points and interior points are now dual. And, most importantly, the dual notions of closure and interior are more symmetrically defined using limit* points: the closure is defined as the set of all limit* points, and the interior is defined as the set of all interior points.
You see that the entire opposite argument works, as I've shown. In fact, this way is the nicer one, because closure and interior both have simpler definitions with limit* point and interior point than with limit point and interior* point. This way, we can say that interior points are just the points in the interior. And similarly we can say that closure points are the points in the closure. What I've been calling limit* points has a standard name: either adherent points or closure points. People make use of "limit* points" because it is a good way of thinking about closures and closed sets, which is simpler in many contexts than limit points. People tend not to make use of "interior* points" to think about interiors and open sets for the converse reason.