Question: In Exercise 9, if Monday is a dry day, what is the expected number of days until a wet day? Suppose we want to know

In Exercise 9, if Monday is a dry day, what is the expected number of days until a wet day?
Suppose we want to know the average (or expected) number of steps it will take to go from state i to state j in a Markov chain. It can be shown that the following computation answers this question: Delete the jth row and the jth column of the transition matrix P to get a new matrix Q. (Keep the rows and columns of Q labeled as they were in P.) The expected number of steps from state i to state j is given by the sum of the entries in the column of (I -Q) -1 labeled i.

Step by Step Solution

3.55 Rating (169 Votes )

There are 3 Steps involved in it

1 Expert Approved Answer
Step: 1 Unlock

The transition matrix from Exercise 9 is To find the expected ... View full answer

blur-text-image
Question Has Been Solved by an Expert!

Get step-by-step solutions from verified subject matter experts

Step: 2 Unlock
Step: 3 Unlock

Document Format (1 attachment)

Word file Icon

859-L-A-L-S (2463).docx

120 KBs Word File

Students Have Also Explored These Related Linear Algebra Questions!