Here is a simple question: Why does it not make sense to define addition on points in geometry?
To be a bit more specific: assume we are talking only about standard Euclidean geometry.
It is clear that a barycentric combination of points is well-defined.
If I understand correctly, it also does not make sense to define the addition of points like this: $P+Q := O + \vec{OP} + \vec{OQ} $ (i.e., just use the position vectors), because the result would not be invariant wrt. different choices of $O$.
But why would it be impossible to define the addition of points in any meaningful way? Or is it?

Any definition of addition will imply the definition of a special origin point $O$, because $O$ can be defined as the point so that $O + A = A$ for any $A$. In Euclidean geometry, we traditionally do not consider an origin point - e.g., it is not defined anywhere in Euclid's Elements. I believe it was not until Cartesian geometry that this idea was considered.
Euclidean geometry is typically considered to be invariant under isometries - transformations of the plane that do not change the distances between two points, such as reflections, rotations and translations. That is, if you take any theorem and proof in Euclidean geometry and apply an isometry to every line and point, the theorem and proof will still be valid. Nothing is assumed about any "absolute" location on the Euclidean plane. Since the result of an addition of two points depends on their location relative to the origin, which may change when you apply such a transformation, it is typically not considered in traditional Euclidean geometry.
tl;dr: Addition is undefined in Euclidean geometry because Euclid never thought of using coordinates.