Question: (a) There is a Markov chain which a flea hopping about at random on the vertices of the transition diagram below. The transition diagram
(a) There is a Markov chain which a flea hopping about at random on the vertices of the transition diagram below. The transition diagram shows a system with 7 possible states. State space, S {1, 2, 3, 4, 5, 6, 7}. 1 3 1 (i) Classify all the states and identify any closed classes. (4 marks) (ii) If the flea starts from state 5, list out all the possible transition probability 11/3
Step by Step Solution
3.57 Rating (157 Votes )
There are 3 Steps involved in it
state The istate of a Markov chain at time t is the value of Xt As Xt6 Then the proc... View full answer
Get step-by-step solutions from verified subject matter experts
