Question: 4. Consider a Markov chain on the set S = {0, 1, 2, . . . } with transition probabilities pi,i+1 = ai , pi,0
4. Consider a Markov chain on the set S = {0, 1, 2, . . . } with transition probabilities pi,i+1 = ai , pi,0 = 1 − ai , where (ai : i ≥ 0) is a sequence of constants satisfying 0 < ai < 1 for all i . Let b0 = 1 and bi = a0a1 · · · ai−1 for i ≥ 1. Show that the chain is
Step by Step Solution
There are 3 Steps involved in it
Get step-by-step solutions from verified subject matter experts
