Question: Find the stationary distribution = (0 1 ... k1). answer in terms of the ratio = p/q. (Hint:PK k=0 xk = xK+11 x1 , for

Find the stationary distribution = (0 1 ... k1). answer in terms of the ratio = p/q. (Hint:PK k=0 xk = xK+11 x1 , for x 6= 1.)

b) Find the limit of 0 as k . Comment.

Find the stationary distribution = (0 1 ... k1). answer in terms

2. [8 marks] Consider the following Markov Chain P P P 10 P q ooe rm? '1 q q q q meq21p a) [5 marks] Find the stationary distribution 7r = (7n) 7T1 . . . m4), Write your answer in terms of the ratio p = p/q. $K+11 (Hint: zfzomk = 331 ,for m 1.) b) [3 marks] Find the limit of no as k > 00. Comment. (Note: the answers may be different for the cases p 1. Give details.)

Step by Step Solution

There are 3 Steps involved in it

1 Expert Approved Answer
Step: 1 Unlock blur-text-image
Question Has Been Solved by an Expert!

Get step-by-step solutions from verified subject matter experts

Step: 2 Unlock
Step: 3 Unlock

Students Have Also Explored These Related Mathematics Questions!