I am trying to prove that:
$$ \Bbb E\left[\int_s^t\sigma e^{-k(t-u)}\sqrt{V_u}dW_u\right] =0$$
Where: $$ dV_t=k~(\theta-V_t)~dt+\sigma\sqrt{V_t}dW_t $$
I have attempted to use Ito's formula on the SDE with $f(x)=\sqrt{x}$ but this doesn't seem to be a good way to go as the argument becomes circular.
Further, the theorem of 'martingality' states that if the integrand is progressively measureable and square integrable then the result follows, but I'm not able to show that $V_t$ satisfies these conditions.
Lets assume that we are in the regime in which $V_t > 0$ for every $t>0$. Consider the sequence of stopping times $$\tau_n = \inf \left\{ t: V_t > n \right\}, \quad n \in \mathbf{N},$$ then, as you mentioned before, if we can show that $\tau_n \to \infty$ as $n \to \infty$ in probability the result follows by standard localization: the expectation at time $t \wedge \tau_n$ would be zero (since the integrand is bounded and hence square integrable), and by taking the limit $n\to \infty$ the expectation will be zero for every $t>0$.
Fix $T>0$, and observe that Ito's product rule combined with some calculus, we can find an upper bound of $\mathbf{P} ( \tau_n < T ) = \mathbf{P}\left( \sup_{ t < T \wedge \tau_n } V_t \geq n \right)$ as a sum of two quantities $$ p_n = \mathbf{P}\left( \sup_{ t \leq T\wedge \tau_n } \left| \theta + \left( V_0 - \theta \right) e^{-kt} \right| > n/2\right), \text{ and } q_n = \mathbf{P}\left( \sigma \sup_{ t \leq T\wedge \tau_n } \left| \int_0^t e^{-k(t - s )}V_sdW_s \right| > n/2\right).$$ Obviously $p_n = 0$ for $n$ large enough, so we need to focus on $q_n$. From Chebychev's and Burkholder-Davis-Gundy Inequalities, it follows that $$ q_n \leq \frac{ 4 \sigma^2 }{n^2} \mathbf{E} \sup_{ t \leq T\wedge \tau_n } e^{-2t}\left| \int_0^{t\wedge \tau_n }e^{s}\sqrt{ V_s} dW(s)\right|^2 \leq\frac{ 4 \sigma^2 }{n^2} \mathbf{E}\int_0^{T\wedge \tau_n }e^{2s}V_sds, $$ which, using the definition of $\tau_n$, implies that $q_n \leq 4 \sigma^2e^{2T}n^{-1}.$ Hence, $\lim_{n \to \infty} \mathbf{P} ( \tau_n < T ) = 0$ and the result follows by localization as before.