I'm considering the Ornstein - Uhlenbeck process $ X(t)=x_{\infty}+e^{-at}(x_{0}-x_{\infty})+b \int_{0}^{t} e^{-a(t-s)} dW(s)$ where $a, b > 0 $ are given constants. I used the Itô Isometry to compute the variance but I did not figure out how to use it to compute the covariance. What is the most general context in which I can use Itô Isometry to compute the covariance?
Thank you for your help.
Let $Y_t=\displaystyle\int_0^t\mathrm e^{au}\mathrm dW_u$ then, for every $t$, $X_t=b\mathrm e^{-at}Y_t+z(t)$ where $z(\ )$ is deterministic hence $$\mathrm{cov}(X_t,X_s)=(b\mathrm e^{-at})(b\mathrm e^{-as})\mathrm{cov}(Y_t,Y_s),$$ and, for every $t$, $Y_t=\displaystyle\int_0^\infty g_t(u)dW_u$ where $g_t$ is deterministic since $g_t(u)=\mathrm e^{au}\mathbf 1_{u\lt t}$ hence $$\mathrm{cov}(Y_t,Y_s)=\int_0^\infty g_t(u)g_s(u)du=\int_0^\infty \mathrm e^{2au}\mathbf 1_{u\lt\min\{t,s\}}du=\int_0^{\min\{t,s\}}\mathrm e^{2au}du=\ldots$$