I have this need to be able to express when a point is "between" two other points. One great example is the binary average operation $Avg:R \times R \rightarrow R$ that takes two real numbers and produces the average of the two (like a mid-point).
Here is a draft of how I would go about defining when a point is between two.
Let M be a metric space with three points a,b and c. A point b is said to be between points a and c iff: $d(a,b) + d(b,c) = d(a,c)$
Is a metric space enough to determine when a point is between two other points through the triangle equality, or will I need some other machinery? Is this the best approach?
There is nothing inherently wrong with this definition. Indeed, so long as you are fine with the possibility that there are no points between anything (the discrete metric) then you are good to go. Depending on the metric you may find it hard to compute these "between" points, but that is perhaps a question best saved for the specific metric space you have in mind.