Question: Please answer the question with clear steps, and don't copy from others, thank you Problem 2. Let (Xn), be a Markov chain on a finite
Please answer the question with clear steps, and don't copy from others, thank you

Problem 2. Let (Xn)", be a Markov chain on a finite state space E with transition matrix II : Ex E -> [0, 1]. Suppose that there exists a k ( N such that II" (x, y) > 0 for all z, y e E. For ne ZA set Yn := (X,, Xnti). (a) (8p) Show that (Y,. )", is a Markov chain on E x E, and determine its transition matrix. (b) (12p) Does the distribution of Y, have a limit as n -> co? If so, determine it
Step by Step Solution
There are 3 Steps involved in it
Get step-by-step solutions from verified subject matter experts
