Question: (a) There is a Markov chain which a flea hopping about at random on the vertices of the transition diagram below. The transition diagram

(a) There is a Markov chain which a flea hopping about at random on the vertices of the transition diagram below. The transit 


(a) There is a Markov chain which a flea hopping about at random on the vertices of the transition diagram below. The transition diagram shows a system with 7 possible states. State space, S {1, 2, 3, 4, 5, 6, 7}. 1 3 1 (i) Classify all the states and identify any closed classes. (4 marks) (ii) If the flea starts from state 5, list out all the possible transition probability 11/3

Step by Step Solution

3.57 Rating (157 Votes )

There are 3 Steps involved in it

1 Expert Approved Answer
Step: 1 Unlock

state The istate of a Markov chain at time t is the value of Xt As Xt6 Then the proc... View full answer

blur-text-image
Question Has Been Solved by an Expert!

Get step-by-step solutions from verified subject matter experts

Step: 2 Unlock
Step: 3 Unlock

Students Have Also Explored These Related Finance Questions!