Question: 4. A Markov chain has 5 states {A, B, C, D, E} and the following transition matrix: 1 0 0 0 0 1/3 0 2/3


4. A Markov chain has 5 states {A, B, C, D, E} and the following transition matrix: 1 0 0 0 0 1/3 0 2/3 0 0 0 1/2 0 1/2 0 . 0 0 3/4 0 1/4 0 1 (a) Which state(s) are absorbing? (b) The system starts in state C. Calculate the probability that it eventually ends up in A. Is it larger or smaller than 50%
Step by Step Solution
There are 3 Steps involved in it
1 Expert Approved Answer
Step: 1 Unlock
Question Has Been Solved by an Expert!
Get step-by-step solutions from verified subject matter experts
Step: 2 Unlock
Step: 3 Unlock
