Question: please help 2. (30 points) Suppose we have a Markov chain Xo, X1, . .. with one step transition matrix NO O 0 0 1
please help

2. (30 points) Suppose we have a Markov chain Xo, X1, . .. with one step transition matrix NO O 0 0 1 P = 1 1/2 1/4 1/4 2 LO 1/6 5/6_ (a) Compute P{X5 = 1 | X3 = 1). (b) What is the long run proportion of time spent in state 1? (c) What is the expected number of steps between two visits to state 0
Step by Step Solution
There are 3 Steps involved in it
Get step-by-step solutions from verified subject matter experts
