"The special states $|0 ⟩$ and $|1 ⟩$ are known as computational basis states, and form an orthonormal basis for this vector space."
Orthonormal means that both the qubits are perpendicular to each other. But if we look at a diagram of the Bloch-Sphere they are at $180^\circ$. I don't get how they are perpendicular to each other.

The Bloch sphere is not embedded in the state space. As it says in the Wikipedia link for the Bloch sphere:
To put this in more mathematical/geometrical terms, the Bloch sphere is identified $\mathbb C P^1$, the 1-dimensional complex projective space, also known as the Riemann sphere in this abstract context.