I am not a connoisseur in the topic of surfaces, the two non-orientable surfaces I know are the Möbius strip and the Klein bottle.
Intuitively I understand that for a surface to be non-orientable, the basis vectors have to flip at some point (while following a given path without changing their relative direction... probably something like parallel transport), so that a basis that was once positively oriented changes to one that has negative orientation, and consequently it makes no sense to talk about orientation. Whenever I think about it, the following image is what comes to mind.
But for this to happen there must be at least one path, tangent to some basis vector, that has to close on itself. In other words, at least one of the directions is bounded. In the particular case of the the Möbius strip and the Klein bottle we also know that the genus is greater than zero (one and two, respectively).
My question is, Are there (finite dimensional) unbounded non-orientable surfaces? Also, Is the genus of these surfaces always greater than zero?



It is difficult to understand what you really want to know, but let me have a try.
It seems that you do not understand by a bounded surface one which is compact. You mention that you expect that "at least one of the directions is bounded" by do not make this precise. However, you say
"Intuitively I understand that for a surface to be non-orientable, the basis vectors have to flip at some point (while following a given path without changing their relative direction... probably something like parallel transport), so that a basis that was once positively oriented changes to one that has negative orientation. ... But for this to happen there must be at least one path, tangent to some basis vector, that has to close on itself."
In fact you are right: For any path $u$ in $M$ one can transport in a well-defined way a given orientation $\omega_x$ at $x = u(0)$ to an orientation $u_*(\omega_x)$ at $y=u(1)$. The manifold $M$ is orientable iff for each closed path $u$ a given orientation $\omega_x$ at $x = u(0)$ is transported to the same orientation $u_*(\omega_x) = \omega_x$ at $u(1) =x$.
In other words, $M$ is non-orientable iff there exists a closed path $u$ transporting a given orientation $\omega_x$ at $x = u(0)$ to the reverse orientation $u_*(\omega_x) = -\omega_x$ at $u(1) =x$. This is true in any dimension.
Moreover, one can show that for homotopic paths $u,v$ one has $u_*(\omega_x) = v_*(\omega_x).$ Thus, if $M$ is simply connected (which means that all closed paths can be contracted to a constant loop), then $M$ is orientable.