2. Consider the Markov chain shown below, where p = 1/4 and the labels on the...

 

 

Transcribed Image Text:

2. Consider the Markov chain shown below, where p = 1/4 and the labels on the arrows indicate the probabilities of making those transitions. 8 1-p 1-p (1) Write down the transition matrix Q for this chain. (2) What is the limit of Q" as n ? (Hint: Use the spectral decomposition Q = VDVT). 2. Consider the Markov chain shown below, where p = 1/4 and the labels on the arrows indicate the probabilities of making those transitions. 8 1-p 1-p (1) Write down the transition matrix Q for this chain. (2) What is the limit of Q" as n ? (Hint: Use the spectral decomposition Q = VDVT).