I have only taken an excerpt from the book from Spivak 3rd edition page 220 in his "Inverse Function" chapter.
At the end of the 3rd paragraph, he says that
Then $f$ takes on some value $f(x) > y$ (because $\alpha$ is the least upper bound)
What does the sup have to do with anything? And why $f(x) > y$? Why not $f(x) < y$? I am guessing (forgive my stupidity here) his purpose in the third paragraph is to tell us that the domain of $f^{-1}$ must also take the form $(a,b)$ or $(a, \infty)$ (assuming $f$ is increasing)
EDIT Let's say $f$ has the domain $(a, b)$ and codomain $(f(c), \infty)$. Then does that mean $f^{-1}$ has a domain $(f(c), \infty)$ and codomain $(a,b)$?

Because $y < \alpha$ and $\alpha$ is the least upper bound of $A$, this means that $y$ is not an upper bound of $A$. So some value in $A$ must properly be bigger (but $\le \alpha$ of course). So (by the definition of $A$) there is some $c \le x < b$ with $f(x) > y$.