Question: 2. Consider the Markov chain shown below, where p = 1/4 and the labels on the arrows indicate the probabilities of making those transitions.

2. Consider the Markov chain shown below, where p = 1/4 and the labels on the arrows indicate the probabilities of making those transitions. 8 1-p 1-p (1) Write down the transition matrix Q for this chain. (2) What is the limit of Q" as n ? (Hint: Use the spectral decomposition Q = VDVT).
Step by Step Solution
There are 3 Steps involved in it
Get step-by-step solutions from verified subject matter experts
