Question

If $x$ is a recurrent state of a discrete Markov chain and the probability to go from $x$ to $y$ is positive, then $y$ is recurrent

score 83 · Answer 1 · 2026-04-02 07:06:09

83

Views

If $x$ is a recurrent state of a discrete Markov chain and the probability to go from $x$ to $y$ is positive, then $y$ is recurrent

Published on 02 Apr 2026 - 7:06

score 63 · Answer 2 · 2026-04-02 07:05:43

63

Views

Under which conditions on a Markov process $X$ does $\frac 1t\lim_{t\downarrow 0}\operatorname P_x\left[X_t\in B\right]$ exist?

Published on 02 Apr 2026 - 7:05

score 609 · Answer 3 · 2026-04-11 14:41:21

609

Views

Is a Markov process uniquely determined?

Published on 11 Apr 2026 - 14:41

score 62 · Answer 4 · 2026-04-11 03:35:52

62

Views

Convergence of autonomous system / time-scale separation

Published on 11 Apr 2026 - 3:35

score 505 · Answer 5 · 2026-04-12 02:09:56

505

Views

General state Markov Chains - references

Published on 12 Apr 2026 - 2:09

score 217 · Answer 6 · 2026-04-02 07:05:44

217

Views

If $X$ is a right-continuous, discrete Markov process, then $\displaystyle\lim_{t\downarrow 0}\operatorname P_x\left[X_t=x\right]=1$

Published on 02 Apr 2026 - 7:05

score 1.3k · Answer 7 · 2026-04-12 22:55:30

1.3k

Views

Why is the movement of a Chess King aperiodic?

Published on 12 Apr 2026 - 22:55

score 1.2k · Answer 8 · 2026-04-11 18:27:16

1.2k

Views

How can I find out the missing Markov transition probabilities given an incomplete transition graph?

Published on 11 Apr 2026 - 18:27

score 8k · Answer 9 · 2026-04-13 21:30:43

8k

Views

Transition probability matrix of a Markov chain.

Published on 13 Apr 2026 - 21:30

score 57 · Answer 10 · 2026-04-02 07:04:39

57

Views

For a discrete Markov process $X$, the probability that $X$ started in $x$ returns to $x$ is always positive. So, there are no absorbing states?!

Published on 02 Apr 2026 - 7:04

score 264 · Answer 11 · 2026-04-13 08:48:05

264

Views

Distinguish positive recurrent, null recurrent and transient

Published on 13 Apr 2026 - 8:48

score 476 · Answer 12 · 2026-04-11 01:33:18

476

Views

Calculating the Stationary Distribution of a Markov Chain

Published on 11 Apr 2026 - 1:33

score 3.3k · Answer 13 · 2026-04-11 23:00:53

3.3k

Views

Convergence of Markov Chain

Published on 11 Apr 2026 - 23:00

score 210 · Answer 14 · 2026-04-11 07:04:04

210

Views

Probability of wearing a hat

Published on 11 Apr 2026 - 7:04

score 202 · Answer 15 · 2026-04-01 14:45:08

202

Views

Prove that uniform distribution on a set of vertices $V$ is stationary if the graph is regular.

Published on 01 Apr 2026 - 14:45

List Question

If $x$ is a recurrent state of a discrete Markov chain and the probability to go from $x$ to $y$ is positive, then $y$ is recurrent

Under which conditions on a Markov process $X$ does $\frac 1t\lim_{t\downarrow 0}\operatorname P_x\left[X_t\in B\right]$ exist?

Is a Markov process uniquely determined?

Convergence of autonomous system / time-scale separation

General state Markov Chains - references

If $X$ is a right-continuous, discrete Markov process, then $\displaystyle\lim_{t\downarrow 0}\operatorname P_x\left[X_t=x\right]=1$

Why is the movement of a Chess King aperiodic?

How can I find out the missing Markov transition probabilities given an incomplete transition graph?

Transition probability matrix of a Markov chain.

For a discrete Markov process $X$, the probability that $X$ started in $x$ returns to $x$ is always positive. So, there are no absorbing states?!

Distinguish positive recurrent, null recurrent and transient

Calculating the Stationary Distribution of a Markov Chain

Convergence of Markov Chain

Probability of wearing a hat

Prove that uniform distribution on a set of vertices $V$ is stationary if the graph is regular.

Trending Questions

Popular # Hahtags

Popular Questions