Question: 4. A Markov chain has 5 states {A, B, C, D, E} and the following transition matrix: 1 0 0 0 0 1/3 0 2/3

 4. A Markov chain has 5 states {A, B, C, D,
E} and the following transition matrix: 1 0 0 0 0 1/3

4. A Markov chain has 5 states {A, B, C, D, E} and the following transition matrix: 1 0 0 0 0 1/3 0 2/3 0 0 0 1/2 0 1/2 0 . 0 0 3/4 0 1/4 0 1 (a) Which state(s) are absorbing? (b) The system starts in state C. Calculate the probability that it eventually ends up in A. Is it larger or smaller than 50%

Step by Step Solution

There are 3 Steps involved in it

1 Expert Approved Answer
Step: 1 Unlock blur-text-image
Question Has Been Solved by an Expert!

Get step-by-step solutions from verified subject matter experts

Step: 2 Unlock
Step: 3 Unlock

Students Have Also Explored These Related Mathematics Questions!