I know in groups we often demand one unique inverse and it brings some particular properties. But what would we call something algebraic where each element has two different inverses?
Does this happen in any algebra? If so, what does it lead to?
Imagine in New York starting at some crossing we go s7a4 : seven streets up and 4 avenues up.
Then inverse (in the sense of taking us back to our original position) could be either s-7a-4 or a-4s-7 depending on if we want to go downwards streets or avenues first. It is completely reasonable to consider these different things as we encounter different stuff on the way. Different amount of traffic, different shops, different bars, and so on.
That can happen in a semigroup: a set with an associative product and (in your case) an identity.
For example, consider the set of finite sequences of unit left and right steps on the line, where multiplication is concatenation. The identity is the empty sequence. Then $p$ will be an inverse of $q$ just when it has the same number of left (right) moves as $q$ has right (left).
You can do this on a grid to model your New York City example. (It's a more interesting challenge if you allow yourself to walk diagonally along Broadway.)
Edit in response to (correct) comments.
It is indeed the action of these operations that matters. The quotient structure that captures the result of an action in this example is just the additive group of the integers acting on the integers: all that matters is the difference between the number of right and left steps.
So more formally I think the algebraic structure the OP is looking for is that of a semigroup acting on a set, not just a semigroup.