Question: In Exercise 9, if Monday is a dry day, what is the expected number of days until a wet day? Suppose we want to know
In Exercise 9, if Monday is a dry day, what is the expected number of days until a wet day?
Suppose we want to know the average (or expected) number of steps it will take to go from state i to state j in a Markov chain. It can be shown that the following computation answers this question: Delete the jth row and the jth column of the transition matrix P to get a new matrix Q. (Keep the rows and columns of Q labeled as they were in P.) The expected number of steps from state i to state j is given by the sum of the entries in the column of (I -Q) -1 labeled i.
Step by Step Solution
3.55 Rating (169 Votes )
There are 3 Steps involved in it
The transition matrix from Exercise 9 is To find the expected ... View full answer
Get step-by-step solutions from verified subject matter experts
Document Format (1 attachment)
859-L-A-L-S (2463).docx
120 KBs Word File
