Question: 7.3. Let X, be an absorbing Markov chain whose transition probability matrix takes the form given in equation (7.1). Let W be the fundamental matrix,

7.3. Let X, be an absorbing Markov chain whose transition probability matrix takes the form given in equation (7.1). Let W be the fundamental matrix, the matrix inverse of I - Q. Let T=min{n?0;rSn -5 N}

be the random time of absorption (recall that states r, r + 1, ... , N are the absorbing states). Establish the joint distribution Pr{XT_, = j, XT = kIXO = i} = W;Pk for 0 <- i, j < r; r:5 k : N, whence N Pr{XT_, = j1X0 = i} = 7, W,.;Pk for 0:i,jk=r

Step by Step Solution

There are 3 Steps involved in it

1 Expert Approved Answer
Step: 1 Unlock blur-text-image
Question Has Been Solved by an Expert!

Get step-by-step solutions from verified subject matter experts

Step: 2 Unlock
Step: 3 Unlock

Students Have Also Explored These Related Probability And Stochastic Modeling Questions!