I would like to understand what is the direction of a point of a topos. A point of a topos $\cal T$ in one source (2nd snippet below) is a functor preserving finite limits and all colimits $$p^*:{\cal T}\to {\text {Set}}$$ to Set.
On wikipedia (1st snippet) it is the reverse direction: from Set to $\cal T$.
As Wikipedia says, a geometric morphism is some pair of adjoint functors ($f^*, f_*$). In particular, the left adjoint $f^*$ goes in the direction opposite to that of the geometric morphism. So directionwise everything is consistent. Note that $f^*$ preserves colimits by adjointness and finite limits because its part of the definition of a geometric morphism.