5. Consider the Markov chain (X) possessing the following transition matrix. .6 .4 0 .2 .5...

Transcribed Image Text:

5. Consider the Markov chain (X) possessing the following transition matrix. .6 .4 0 .2 .5 .3 0 .1 .9 P = Define new random variables Y = X - X1. Then (Y) is a stochastic process, but is it a Markov chain? Answer the following questions. a. What is the state space for {Y}? b. Does {Y} satisfy the Markov property? If yes, then give the transition matrix. If not, demonstrate how the Markov property is violated. 5. Consider the Markov chain (X) possessing the following transition matrix. .6 .4 0 .2 .5 .3 0 .1 .9 P = Define new random variables Y = X - X1. Then (Y) is a stochastic process, but is it a Markov chain? Answer the following questions. a. What is the state space for {Y}? b. Does {Y} satisfy the Markov property? If yes, then give the transition matrix. If not, demonstrate how the Markov property is violated.