Consider the DTMC with state space {1, 2, 3, 4, 5, 6) with the following transition...

 

Transcribed Image Text:

Consider the DTMC with state space {1, 2, 3, 4, 5, 6) with the following transition matrix 0.2 0.3 0.1 0 0.1 0.31 0.5 0 0.3 0.1 0 0.1 0 0 0.4 0.6 00 P = 0 0 1 0 0 0 0 0 0 0 0.5 0.5 0 0 0 0 0.4 0.6 a. Classify the states, define open and closed communicating classes. b. Calculate I. Consider the DTMC with state space {1, 2, 3, 4, 5, 6) with the following transition matrix 0.2 0.3 0.1 0 0.1 0.31 0.5 0 0.3 0.1 0 0.1 0 0 0.4 0.6 00 P = 0 0 1 0 0 0 0 0 0 0 0.5 0.5 0 0 0 0 0.4 0.6 a. Classify the states, define open and closed communicating classes. b. Calculate I.