(a) There is a Markov chain which a flea hopping about at random on the vertices...

 

Transcribed Image Text:

(a) There is a Markov chain which a flea hopping about at random on the vertices of the transition diagram below. The transition diagram shows a system with 7 possible states. State space, S {1, 2, 3, 4, 5, 6, 7}. 1 3 1 (i) Classify all the states and identify any closed classes. (4 marks) (ii) If the flea starts from state 5, list out all the possible transition probability 11/3 (a) There is a Markov chain which a flea hopping about at random on the vertices of the transition diagram below. The transition diagram shows a system with 7 possible states. State space, S {1, 2, 3, 4, 5, 6, 7}. 1 3 1 (i) Classify all the states and identify any closed classes. (4 marks) (ii) If the flea starts from state 5, list out all the possible transition probability 11/3

Answer rating: 100% (QA)

state The istate of a Markov chain at time t is the value of Xt As Xt6 Then the proc... View the full answer