Question

Expectation of hitting time for the asymmetric random walk via Martingale

score 218 · Answer 1 · 2026-03-30 23:24:42

218

Views

Expectation of hitting time for the asymmetric random walk via Martingale

Published on 30 Mar 2026 - 23:24

score 65 · Answer 2 · 2023-12-23 06:40:58

65

Views

Combining several matrices into a single matrix — Is this possible?

Published on 23 Dec 2023 - 6:40

score 27 · Answer 3 · 2026-04-09 02:02:52

27

Views

Performance Loss for High-order Markov Decision Process Using Lower-order Policy

Published on 09 Apr 2026 - 2:02

score 33 · Answer 4 · 2026-03-28 06:40:31

33

Views

Bayesian Analysis: Why do MCMC instead of just calculating thousands of values at equally spaced increments for the numerator and then normalizing?

Published on 28 Mar 2026 - 6:40

score 29 · Answer 5 · 2023-12-28 20:27:43

29

Views

Markov Chain long-term probability of reaching single absorbing recurrent state

Published on 28 Dec 2023 - 20:27

score 47 · Answer 6 · 2026-04-08 17:42:29

47

Views

Getting confused in Markov Chain question

Published on 08 Apr 2026 - 17:42

score 57 · Answer 7 · 2023-12-31 14:12:15

57

Views

Proof - Non-regularity condition for right stochastic matrices

Published on 31 Dec 2023 - 14:12

score 40 · Answer 8 · 2026-04-08 22:53:51

40

Views

Question about the mean first passage time

Published on 08 Apr 2026 - 22:53

score 63 · Answer 9 · 2026-03-26 14:20:43

63

Views

Example of a Markov Chain which is stationary but not reversible

Published on 26 Mar 2026 - 14:20

score 344 · Answer 10 · 2024-01-02 19:13:45

344

Views

Bacteria either die or double depending on whether it turns left or right. If we start with $n$ bacteria, what's the best long-term survival strategy?

Published on 02 Jan 2024 - 19:13

score 42 · Answer 11 · 2024-01-02 22:31:42

42

Views

Number of rainy days probability distribution in a two-state markov chain

Published on 02 Jan 2024 - 22:31

score 85 · Answer 12 · 2024-01-03 09:36:01

85

Views

"Expected rolls to get a 6": recursion vs infinite sum

Published on 03 Jan 2024 - 9:36

score 37 · Answer 13 · 2026-04-09 12:20:30

37

Views

Escape speed of simple random walk on integer lattice

Published on 09 Apr 2026 - 12:20

score 16 · Answer 14 · 2026-03-09 12:49:45

16

Views

Showing Null Recurrence in M/M/s queue for Markov Chains

Published on 09 Mar 2026 - 12:49

score 68 · Answer 15 · 2026-04-01 02:29:11

68

Views

Gamblers ruin- Expected number of returns

Published on 01 Apr 2026 - 2:29

List Question

Expectation of hitting time for the asymmetric random walk via Martingale

Combining several matrices into a single matrix — Is this possible?

Performance Loss for High-order Markov Decision Process Using Lower-order Policy

Bayesian Analysis: Why do MCMC instead of just calculating thousands of values at equally spaced increments for the numerator and then normalizing?

Markov Chain long-term probability of reaching single absorbing recurrent state

Getting confused in Markov Chain question

Proof - Non-regularity condition for right stochastic matrices

Question about the mean first passage time

Example of a Markov Chain which is stationary but not reversible

Bacteria either die or double depending on whether it turns left or right. If we start with $n$ bacteria, what's the best long-term survival strategy?

Number of rainy days probability distribution in a two-state markov chain

"Expected rolls to get a 6": recursion vs infinite sum

Escape speed of simple random walk on integer lattice

Showing Null Recurrence in M/M/s queue for Markov Chains

Gamblers ruin- Expected number of returns

Trending Questions

Popular # Hahtags

Popular Questions