Law of total expectation
If $\mathbb{E}\big[|X|\big]$ finite then for any $Y,\;\mathbb{E}\big[\mathbb{E}[X\mid Y]\big]=\mathbb{E}[X]$
I remember reading this for the first time and thinking... hold up, what?
The proof is simple, but I am wondering whether there is an intuitive reason why we might expect this result?
The conditional expectation of $X$ with respect to $Y$ is our best estimate of $X$ given exact knowledge of $Y.$ The expectation of any variable is our best estimate, given no specific knowledge about any variable at all. It seems reasonable then that our a priori expectation of the variable $E[X|Y]$ before we have any knowledge of $Y$ is just the general expectation of $X.$