The probability distribution function (PDF) of sample Pearson correlation coefficient for bi-variate Gaussian is available in the literature. For example see : http://mathworld.wolfram.com/CorrelationCoefficientBivariateNormalDistribution.html
Now, my problem is this: I have bi-varite Gaussian random variables say $w[n]$ and $z[n]$ with correlation coefficient $\rho_{wz}$ and individual variances $\sigma_1^2$ and $\sigma_2^2$, respectively. Now consider the AR(1) model with $$x[n]=\alpha x[n-1]+w[n] \\ y[n]=\beta y[n-1]+z[n]$$
- Are $x[n]$ and $y[n]$ bi-variate Gaussian?
- What is the PDF of the correlation coefficient of that bi-variate Gaussian?
Any help or pointers to references will be appreciated. Thanks
My Try:
We can write the above processes as $$x[n]=\sum_{i=0}^{n}\alpha^{n-i}w[i] = \mathbf{\alpha}_n^T\mathbf{w}_n$$ $$y[n]=\sum_{i=0}^{n}\beta^{n-i}z[i] =\mathbf{\beta}_n^T\mathbf{z}_n$$
Clearly $x[n]$ and $y[n]$ are Gaussian with mean 0 and variances $\sigma_x^2=\frac{1-(\alpha^2)^{(n+1)}}{1-\alpha^2}$ and $\sigma_y^2=\frac{1-(\beta^2)^{(n+1)}}{1-\beta^2}$, respectively. Are $x[n]$ and $y[n]$ bi-variate Gaussian? Let us consider the covariance between $x[n]$ and $y[n]$ given by
\begin{equation} \begin{split} \mathbb{E}[x[n]y[n]] &= \mathbb{E}[x[n]y[n]] \\ &= \mathbb{E}[\mathbf{\alpha}_n^T\mathbf{w}_n \mathbf{\beta}_n^T\mathbf{z}_n] \\ &= \mathbb{E}[\mathbf{\alpha}_n^T\mathbf{w}_n \mathbf{z}_n^T\mathbf{\beta}_n]\\ &= \mathbf{\alpha}_n^T \mathbb{E}[\mathbf{w}_n \mathbf{z}_n^T]\mathbf{\beta}_n\\ \end{split} \end{equation} where the matrix $$\mathbb{E}[\mathbf{w}_n \mathbf{z}_n^T]= \begin{bmatrix} \rho_{wz} \sigma_1\sigma_2 & \rho_{wz} \sigma_1\sigma_2 & \rho_{wz}\sigma_1\sigma_2 & \dots & \rho_{wz} \sigma_1\sigma_2\\ \rho_{wz} \sigma_1\sigma_2 & \rho_{wz}\sigma_1\sigma_2 & \rho_{wz} \sigma_1\sigma_2& \dots & \rho_{wz}\sigma_1\sigma_2 \\ \vdots & & & & \vdots \\ \rho_{wz} \sigma_1\sigma_2 & \rho_{wz} \sigma_1\sigma_2& \rho_{wz} \sigma_1\sigma_2& \dots & \rho_{wz}\sigma_1\sigma_2 \end{bmatrix} = \rho_{wz} \sigma_1\sigma_2 \begin{bmatrix} 1 & 1 & 1 & \dots & 1\\ \vdots & & & & \vdots \\ 1 & 1& 1& \dots & 1 \end{bmatrix}$$
Now, \begin{equation} \begin{split} \mathbb{E}[x[n]y[n]] &= \mathbf{\alpha}_n^T \mathbb{E}[\mathbf{w}_n \mathbf{z}_n^T]\mathbf{\beta}_n\\ & = \rho_{wz}\sigma_1\sigma_2 \frac{1-\alpha^{(n+1)}}{1-\alpha} \frac{1-\beta^{(n+1)}}{1-\beta} \\ \rho_{xy}& = \rho_{wz}\frac{\sigma_1}{\sigma_x} \frac{\sigma_2}{\sigma_y} \frac{1-\alpha^{(n+1)}}{1-\alpha} \frac{1-\beta^{(n+1)}}{1-\beta} \end{split} \end{equation}
Can anyone verify the above math. statements?
My new Try:
For the first equation, bring the $X$ terms over to the left hand side. Write the same equation for $ n , n-1, n-2 $ etc. Multiply each equation starting from the $X[n-1] $ equation by $ \alpha, \alpha^2, \alpha^3$ etc. Add the equations vertically. On the left hand side there will be telescoping cancellations and you will be left with the $ X[n] $ and $X[1] $ terms.On the right hand side you will have a sum of bivariate Gaussian variables which is also bivariate Gaussian. You could use the moment generating function idea to see what parameters it has and then refer back to your link to see what the PDF of the correlation coefficient is.