Question

How to prove a Markov chain is irreducible in general?

score 1k · Answer 1 · 2019-03-09 09:24:35

1k

Views

How to prove a Markov chain is irreducible in general?

Published on 09 Mar 2019 - 9:24

score 127 · Answer 2 · 2026-03-26 11:06:25

127

Views

Asymmetric random walks: eigenvalues and spectral gap

Published on 26 Mar 2026 - 11:06

score 157 · Answer 3 · 2026-03-26 18:59:39

157

Views

Transition matrix involving broken machine taking geometric time to fix

Published on 26 Mar 2026 - 18:59

score 96 · Answer 4 · 2026-02-23 04:42:58

96

Views

If $A$ and $B$ are transition matrices such that $||A-B|| < c$, then what can we say about $||A^n-B^n||$ for a given $n$?

Published on 23 Feb 2026 - 4:42

score 233 · Answer 5 · 2026-03-26 10:59:44

233

Views

Expected number of steps before leaving a ball

Published on 26 Mar 2026 - 10:59

score 172 · Answer 6 · 2019-03-10 04:49:04

172

Views

Getting started with Markov Chain.

Published on 10 Mar 2019 - 4:49

score 413 · Answer 7 · 2019-03-10 15:43:21

413

Views

Why is this model not a Markov chain?

Published on 10 Mar 2019 - 15:43

score 606 · Answer 8 · 2026-03-25 01:14:10

606

Views

Help using eigenvectors to solve Markov chain

Published on 25 Mar 2026 - 1:14

score 333 · Answer 9 · 2026-03-26 19:05:16

333

Views

What would be the value of $P$ in this example?

Published on 26 Mar 2026 - 19:05

score 79 · Answer 10 · 2019-03-11 01:00:07

79

Views

Is there any difference between the notations in case of Markov Chains?

Published on 11 Mar 2019 - 1:00

score 106 · Answer 11 · 2026-03-26 11:03:15

106

Views

The property that there exists an $r \in (0, 1)$ such that $P(Z_n = x) \leq r^n$ for a random walk $(Z_n)_{n \geq 0}$.

Published on 26 Mar 2026 - 11:03

score 617 · Answer 12 · 2026-03-27 13:46:22

617

Views

Writing action-value function in terms of state-value function for a Markov decision process

Published on 27 Mar 2026 - 13:46

score 10.4k · Answer 13 · 2019-03-11 10:01:59

10.4k

Views

Intuition behind positive recurrent and null recurrent Markov Chains

Published on 11 Mar 2019 - 10:01

score 255 · Answer 14 · 2019-03-11 11:43:20

255

Views

If I have the $Q$ matrix, can I somehow find the $P$ matrix?

Published on 11 Mar 2019 - 11:43

score 42 · Answer 15 · 2026-03-26 19:05:45

42

Views

What would be the value of $P$ in this example? (2)

Published on 26 Mar 2026 - 19:05

List Question

How to prove a Markov chain is irreducible in general?

Asymmetric random walks: eigenvalues and spectral gap

Transition matrix involving broken machine taking geometric time to fix

If $A$ and $B$ are transition matrices such that $||A-B|| < c$, then what can we say about $||A^n-B^n||$ for a given $n$?

Expected number of steps before leaving a ball

Getting started with Markov Chain.

Why is this model not a Markov chain?

Help using eigenvectors to solve Markov chain

What would be the value of $P$ in this example?

Is there any difference between the notations in case of Markov Chains?

The property that there exists an $r \in (0, 1)$ such that $P(Z_n = x) \leq r^n$ for a random walk $(Z_n)_{n \geq 0}$.

Writing action-value function in terms of state-value function for a Markov decision process

Intuition behind positive recurrent and null recurrent Markov Chains

If I have the $Q$ matrix, can I somehow find the $P$ matrix?

What would be the value of $P$ in this example? (2)

Trending Questions

Popular # Hahtags

Popular Questions