Question: Consider a random walk in the set {0,1,..., M} with transition probabilities P01 1, PM,M-1 = 1, and Pi,i-1 = 9, pi,i+1 = P,
Consider a random walk in the set {0,1,..., M} with transition probabilities P01 1, PM,M-1 = 1, and Pi,i-1 = 9, pi,i+1 = P, Pi,i = 1-p -q for i = 1, ..., M - 1. (a) Sketch the state transition diagram. (b) Find the long-term proportion of time spent in each state, and the limit of p; (n) as = n 0.
Step by Step Solution
3.47 Rating (160 Votes )
There are 3 Steps involved in it
Lets break down the problem a State Transition Diagram The random walk takes place in the set 0 1 M ... View full answer
Get step-by-step solutions from verified subject matter experts
