List questions from markov-chains

Published on 02 Apr 2026 - 12:26

272

Views

Communication classes for Markov Chain with multiple nodes connecting

Published on 19 Nov 2015 - 12:57

25

Views

Alternate Markvov Chain Model.

Published on 21 Nov 2015 - 11:08

202

Views

Galton Watson Process: Probability that the population will be died

Published on 14 Apr 2026 - 1:40

489

Views

finite state markov chain stationary distribution existence

Published on 14 Apr 2026 - 8:01

298

Views

Show $S_N = \sum\limits_{n=1}^{N} \text{sign}(Y-X_n)$ is Markov, $(X_n),Y $ iid Uniform(0,1)

Published on 24 Nov 2015 - 15:38

63

Views

Calculating integral with antithetic variables

Published on 26 Mar 2026 - 19:40

19

Views

Show that $\lambda_1 S_1$ is exponential of parameter 1.

Published on 27 Mar 2026 - 2:34

358

Views

Markov chain stationary distribution

Published on 26 Nov 2015 - 4:19

90

Views

Doubt about the transition intensities

Published on 09 Apr 2026 - 17:07

725

Views

Irreducible Markov chain with period $d>1$ (Extension of a previous question)

Published on 12 Apr 2026 - 16:55

140

Views

$X_n$ Markov Chain, show Show that: $\mathbb{E}^{\mathbb{P}_x}[\tau_x] \geq \mathbb{P}_x(\tau_y < \tau_x) \mathbb{E}^{\mathbb{P}_y}[\tau_x]$

Published on 28 Nov 2015 - 21:22

273

Views

Reversible probability for a Markov Chain.

Published on 11 Apr 2026 - 12:00

1k

Views

Umbrella Markov chain problem

Published on 12 Apr 2026 - 17:43

664

Views

Computing the expected number of steps of a random walk

Published on 10 Apr 2026 - 20:48

List Question

A stationary distribution of Markov chain

Communication classes for Markov Chain with multiple nodes connecting

Alternate Markvov Chain Model.

Galton Watson Process: Probability that the population will be died

finite state markov chain stationary distribution existence

Show $S_N = \sum\limits_{n=1}^{N} \text{sign}(Y-X_n)$ is Markov, $(X_n),Y $ iid Uniform(0,1)

Calculating integral with antithetic variables

Show that $\lambda_1 S_1$ is exponential of parameter 1.

Markov chain stationary distribution

Doubt about the transition intensities

Irreducible Markov chain with period $d>1$ (Extension of a previous question)

$X_n$ Markov Chain, show Show that: $\mathbb{E}^{\mathbb{P}_x}[\tau_x] \geq \mathbb{P}_x(\tau_y < \tau_x) \mathbb{E}^{\mathbb{P}_y}[\tau_x]$

Reversible probability for a Markov Chain.

Umbrella Markov chain problem

Computing the expected number of steps of a random walk

Trending Questions

Popular # Hahtags

Popular Questions