Question

Computing $\lim_n P(X_n=A|X_0=C)$ of a Markov chain

score 157 · Answer 1 · 2026-03-29 20:45:34

157

Views

Computing $\lim_n P(X_n=A|X_0=C)$ of a Markov chain

Published on 29 Mar 2026 - 20:45

score 624 · Answer 2 · 2026-03-29 20:38:44

624

Views

Markov chain for a board game with dice rolls

Published on 29 Mar 2026 - 20:38

score 115 · Answer 3 · 2026-03-28 19:37:58

115

Views

homogeneous one-dimensional random walk

Published on 28 Mar 2026 - 19:37

score 378 · Answer 4 · 2026-03-28 19:30:54

378

Views

Probability an ant returns to its starting vertex on an octahedron after $6$ moves

Published on 28 Mar 2026 - 19:30

score 99 · Answer 5 · 2026-03-28 21:26:49

99

Views

Intuition behind fair vs biased result for Gambler's Ruin problem

Published on 28 Mar 2026 - 21:26

score 66 · Answer 6 · 2020-06-28 09:43:00

66

Views

The definition of stationary distribution of a Markov chain seems strange

Published on 28 Jun 2020 - 9:43

score 30 · Answer 7 · 2020-06-29 10:28:03

30

Views

Why $O(\lambda_\text{max}^{\tau/2})=O(1/n^2)$ for $\tau=\frac{4\ln n}{1-\lambda_\text{max}}$?

Published on 29 Jun 2020 - 10:28

score 480 · Answer 8 · 2026-04-03 09:29:34

480

Views

Proving a formula for the stationary distribution of a finite irreducible Markov chain

Published on 03 Apr 2026 - 9:29

score 401 · Answer 9 · 2026-03-29 20:45:46

401

Views

Persistent Markov Chain with infinite mean recurrence time

Published on 29 Mar 2026 - 20:45

score 612 · Answer 10 · 2026-03-28 21:34:12

612

Views

Let $P$ be the transition matrix of random walk on $n$-cycle($n$ is odd). Find the smallest value of $t$ such that $Pt(x, y) > 0$ for all $x$ and $y.$

Published on 28 Mar 2026 - 21:34

score 186 · Answer 11 · 2020-07-01 10:06:47

186

Views

Property of a transient Markov chain

Published on 01 Jul 2020 - 10:06

score 363 · Answer 12 · 2020-07-02 19:16:58

363

Views

Does Markov Chain with infinite state space (i.e. S = {0,1,2,...} have equilibrium distribution?

Published on 02 Jul 2020 - 19:16

score 195 · Answer 13 · 2026-03-27 03:48:23

195

Views

Markov chain conditional limit

Published on 27 Mar 2026 - 3:48

score 279 · Answer 14 · 2026-03-26 11:03:41

279

Views

DTMC with a stationary distribution is positive recurrent

Published on 26 Mar 2026 - 11:03

score 196 · Answer 15 · 2020-07-03 13:03:54

196

Views

Expected number of unique transient states visited in an absorbing markov chain.

Published on 03 Jul 2020 - 13:03

List Question

Computing $\lim_n P(X_n=A|X_0=C)$ of a Markov chain

Markov chain for a board game with dice rolls

homogeneous one-dimensional random walk

Probability an ant returns to its starting vertex on an octahedron after $6$ moves

Intuition behind fair vs biased result for Gambler's Ruin problem

The definition of stationary distribution of a Markov chain seems strange

Why $O(\lambda_\text{max}^{\tau/2})=O(1/n^2)$ for $\tau=\frac{4\ln n}{1-\lambda_\text{max}}$?

Proving a formula for the stationary distribution of a finite irreducible Markov chain

Persistent Markov Chain with infinite mean recurrence time

Let $P$ be the transition matrix of random walk on $n$-cycle($n$ is odd). Find the smallest value of $t$ such that $Pt(x, y) > 0$ for all $x$ and $y.$

Property of a transient Markov chain

Does Markov Chain with infinite state space (i.e. S = {0,1,2,...} have equilibrium distribution?

Markov chain conditional limit

DTMC with a stationary distribution is positive recurrent

Expected number of unique transient states visited in an absorbing markov chain.

Trending Questions

Popular # Hahtags

Popular Questions