Here's Prob. 8 in the Problems after Sec. 3.2 in Introductory Functional Analysis With Applications by Erwine Kreyszig:
Show that in an inner product space, $x \perp y$ if and only if $\Vert x + \alpha y \Vert \ge \Vert x \Vert$ for all scalars $\alpha$.
If $x \perp y$, then $\langle x, y \rangle = 0$; so for any scalar $\alpha$, we have $$ \begin{align*} \Vert x + \alpha y \Vert^2 &= \langle x + \alpha y, x + \alpha y \rangle \\ &= \Vert x \Vert^2 + 2 \Re \bar{\alpha} \langle x, y \rangle + \vert \alpha \vert^2 \ \Vert y \Vert^2 \\ &= \Vert x \Vert^2 + \vert \alpha \vert^2 \ \Vert y \Vert^2 \\ &\ge \Vert x \Vert^2. \end{align*} $$ So $$ \Vert x + \alpha y \Vert \geq \Vert x \Vert. $$
Am I right?
Now how to prove the converse? It is my guess that we will have to put in a particular value for $\alpha$.
Assumig \begin{align*} \Vert x \Vert^2 + 2 \Re \bar{\alpha} \langle x, y \rangle + \vert \alpha \vert^2 \ \Vert y \Vert^2 \ge \Vert x \Vert^2, \end{align*} we get \begin{align*} 2 \Re \bar{\alpha} \langle x, y \rangle + \vert \alpha \vert^2 \ \Vert y \Vert^2 \ge 0 \end{align*} and \begin{align} \Re \bar{\alpha} \langle x, y \rangle \ge -\frac{1}{2} \vert \alpha \vert^2 \ \Vert y \Vert^2. \end{align}
Now take $\alpha = 2\varepsilon / \Vert y \Vert^2 > 0$, and you can cancel $\alpha$ from both sides to get \begin{align*} \Re \langle x, y \rangle \ge -\frac{1}{2} \alpha \Vert y \Vert^2 =-\varepsilon. \end{align*}
Since this holds for all $\varepsilon$, we get $\Re \langle x, y \rangle \ge 0$. Similarly, taking $\alpha = - 2\varepsilon / \Vert y \Vert^2$, we get $\Re \langle x, y \rangle \le 0$, and hence $\Re \langle x, y \rangle = 0$.
In the same manner, taking $\alpha = \pm i 2\varepsilon / \Vert y \Vert^2$, one can show that $\Im \langle x, y \rangle =0$.
A slightly shorter argument along the same lines, is as follows. Assume $\langle x, y \rangle = |\langle x, y \rangle| e^{i\theta}$. Taking $\alpha :=e^{i\theta} 2\varepsilon / \Vert y \Vert^2$, gives \begin{align*} \Re \bar{\alpha} \langle x, y \rangle = \Re \big(e^{-i\theta} |\alpha| |\langle x, y \rangle| e^{i\theta}\big) = |\alpha| |\langle x, y \rangle| \end{align*} from which we get $|\langle x, y \rangle| \le 0$ and similarly taking $\alpha :=e^{i(\theta-\pi)} 2\varepsilon / \Vert y \Vert^2$, gives $|\langle x, y \rangle| \ge 0$.