Question 1) Consider the 1-step transition matrix Markov Chain given below. P= 0.5 0 0.5 0...

Transcribed Image Text:

Question 1) Consider the 1-step transition matrix Markov Chain given below. P= 0.5 0 0.5 0 0.2 0 0.8 0.25 0.75 0 0 0.6 0 0.4 a) Write the communicating classes in the Markov Chain. b) Write whether the states of the Markov Chain are temporary or recurring states. If it is a temporary condition, explain why it is temporary, and if it is a recurring condition, explain why it is recurrent. c) Is there a limit (steady state) distribution? If so, why does it exist? Otherwise why not? Explain. If there is a limit (steady state) distribution, find it. Question 1) Consider the 1-step transition matrix Markov Chain given below. P= 0.5 0 0.5 0 0.2 0 0.8 0.25 0.75 0 0 0.6 0 0.4 a) Write the communicating classes in the Markov Chain. b) Write whether the states of the Markov Chain are temporary or recurring states. If it is a temporary condition, explain why it is temporary, and if it is a recurring condition, explain why it is recurrent. c) Is there a limit (steady state) distribution? If so, why does it exist? Otherwise why not? Explain. If there is a limit (steady state) distribution, find it.