Question: Please help quickly, I don't understand Markov Chains at all. T is the transition matrix for a 4-State absorbing Markov Chain. State #1 and state
Please help quickly, I don't understand Markov Chains at all.

T is the transition matrix for a 4-State absorbing Markov Chain. State #1 and state #2 are absorbing states. 1 0 O 0 O 1 O 0 0 0.4 0.1 0.5 0.4 0 0.5 0.1 Use the standard methods for absorbing Markov Chains to nd the matrices N = (i - Q)'1 and 5 = NR. Answer the following questions based on these matrices. (Give your answers correct to 2 decimal places.) (a) If you start in state #3, what is the expected number of steps needed to reach an absorbing state. (Your answer will come from the matrix N.) steps (b) If you start in state #4, what is the expected number of steps needed to reach an absorbing sate. (Your answer here will come from the matrix N.) steps (c) If you start in state #3, what is the probability that you will eventually land in state #1? (Youranswer will come from the matrix B.) (d) If you start in state #4, what is the probability that you will eventually land in state #17 (Your answer will came from the matrix B.)
Step by Step Solution
There are 3 Steps involved in it
Get step-by-step solutions from verified subject matter experts
