How do you explain $f(x_4|x_3)f(x_3|x_2)f(x_2|x_1)f(x_1) = f(x_4,x_3,x_2,x_1)$?

139 Views Asked by At

Let $x_1=x(n_1)$, $x_2=x(n_2)$, $x_3=x(n_3)$ and $x_4=x(n_4)$ be random Markov processes $(n_1 < n_2 < n_3 < n_4)$.

I don't understand the identity given below on their probability density functions.
Where does it come from. How is it derived? Please explain it clearly.

$$ \begin{array}{rcl} f(x_4|x_3)f(x_3|x_2)f(x_2|x_1)f(x_1) & = & f(x_4|x_3)f(x_3|x_2)f(x_2,x_1) \\ & = & f(x_4|x_3)f(x_3,x_2,x_1) \\ & = & f(x_4,x_3,x_2,x_1) \\ \end{array} $$

2

There are 2 best solutions below

0
On BEST ANSWER

This is to address your revised question -- the Markov Chain, where $x_4$ depends only on $x_3$, $x_3$ on $x_2$...

In general, $f(x_4,x_3,x_2,x_1) = f(x_4|x_3,x_2,x_1)f(x_3,x_2,x_1)$, which means $x_4$ depends on all the $x_3,x_2,x_1$. Obviously, one can decompose $f(x_3,x_2,x_1)$ recursively until $x_1$ and finally one arrives at full decomposition (in a lengthy form).

However, in case of Markov Chain, we have $x_4$ depends only on $x_3$ (instead of all the $x_3,x_2,x_1$). This is to say $f(x_4|x_3,x_2,x_1) = f(x_4|x_3)$. Noting this, decompose recursively and you get precisely the identity in your question!

3
On

This equation, which in essence a way to decompose the Density Function, does not always hold! As it implies, the variables here are actually conditionally dependent such that their relationships can be captured by a Directed Acyclic Graph. You can refer to any textbook on probabilistic Graphic Model (e.g., the so-called PRML)