Question

Definitions of recurrence / transience (Discrete-time Markov Chains)

score 28 · Answer 1 · 2020-05-28 00:13:13

28

Views

Definitions of recurrence / transience (Discrete-time Markov Chains)

Published on 28 May 2020 - 0:13

score 52 · Answer 2 · 2020-05-29 08:16:15

52

Views

Markov chain on $\mathcal{Z}$, hitting probability after having done negative jumps of total magnitude $k$

Published on 29 May 2020 - 8:16

score 146 · Answer 3 · 2026-03-29 19:11:44

146

Views

How do you find the probability of a continuous-time markov chain, where having started in state $i$, will be in $j$ state at time $t$?

Published on 29 Mar 2026 - 19:11

score 66 · Answer 4 · 2020-05-29 21:59:32

66

Views

Proving distribution is reversible condition

Published on 29 May 2020 - 21:59

score 524 · Answer 5 · 2026-03-29 17:25:21

524

Views

Consider a branching process $\{X_n , n \geq 0 \}$ in which the offspring distribution is binomial $(k,p)$

Published on 29 Mar 2026 - 17:25

score 162 · Answer 6 · 2026-03-27 15:10:50

162

Views

How to prove that Markov chain with specific transition probabilities has independent increments?

Published on 27 Mar 2026 - 15:10

score 164 · Answer 7 · 2026-03-25 17:24:32

164

Views

Dyck path - Probability of stopping time $2n$

Published on 25 Mar 2026 - 17:24

score 99 · Answer 8 · 2026-04-02 23:34:31

99

Views

Need a help with Markov Chain

Published on 02 Apr 2026 - 23:34

score 38 · Answer 9 · 2026-03-29 17:31:45

38

Views

About measures acting on measurable functions.

Published on 29 Mar 2026 - 17:31

score 64 · Answer 10 · 2020-06-02 21:00:48

64

Views

is there any relation between the right eigenvectors of $P^\top$ and $\begin{bmatrix}0 &P^\top \\P &0\end{bmatrix}$?

Published on 02 Jun 2020 - 21:00

score 141 · Answer 11 · 2020-06-02 22:11:29

141

Views

Extracting a smaller Markov chain from a larger Markov chain

Published on 02 Jun 2020 - 22:11

score 782 · Answer 12 · 2026-04-03 01:05:35

782

Views

Question on the use of the Markov Kernel for conditional probability

Published on 03 Apr 2026 - 1:05

score 396 · Answer 13 · 2026-04-03 00:59:02

396

Views

Conditional expectation of markov chain

Published on 03 Apr 2026 - 0:59

score 55 · Answer 14 · 2026-03-28 09:50:17

55

Views

For ergodic Markov chains, when does $\lim_{N\to\infty} \mathbb{E}[\sum_{n=1}^{N}f(X_n)] - N\mu(f)$ exist

Published on 28 Mar 2026 - 9:50

score 602 · Answer 15 · 2020-06-03 13:42:32

602

Views

Reference request: convergence for periodic Markov chains

Published on 03 Jun 2020 - 13:42

List Question

Definitions of recurrence / transience (Discrete-time Markov Chains)

Markov chain on $\mathcal{Z}$, hitting probability after having done negative jumps of total magnitude $k$

How do you find the probability of a continuous-time markov chain, where having started in state $i$, will be in $j$ state at time $t$?

Proving distribution is reversible condition

Consider a branching process $\{X_n , n \geq 0 \}$ in which the offspring distribution is binomial $(k,p)$

How to prove that Markov chain with specific transition probabilities has independent increments?

Dyck path - Probability of stopping time $2n$

Need a help with Markov Chain

About measures acting on measurable functions.

is there any relation between the right eigenvectors of $P^\top$ and $\begin{bmatrix}0 &P^\top \\P &0\end{bmatrix}$?

Extracting a smaller Markov chain from a larger Markov chain

Question on the use of the Markov Kernel for conditional probability

Conditional expectation of markov chain

For ergodic Markov chains, when does $\lim_{N\to\infty} \mathbb{E}[\sum_{n=1}^{N}f(X_n)] - N\mu(f)$ exist

Reference request: convergence for periodic Markov chains

Trending Questions

Popular # Hahtags

Popular Questions