Work out please

Consider a Markov chain {Xn : n = 0, 1, 2, ...} with state space {1, 2, 3} and one-step transition probability matrix O NIH NIH P = O 0 O (a) Mark O or X: ( ) The Markov chain is irreducible. ( ) The Markov chain is aperiodic. ( ) The Markov chain is transient. ( ) The Markov chain is recurrent. ( ) The Markov chain is null recurrent. ( ) The Markov chain is ergodic. (b) Calculate P(X5 = 1/X2 = 1). (c) Find limn + P(Xn = 1/X2 = 1).Consider a Markov chain {Xn, n = 0, 1, . ..} on the state space S = {0, 1, 2}. Suppose that the Markov chain has the transition matrix 2 10 10 10 2 P = 3 10 2 4 10 10 1. Show that the Markov chain has a unique stationary mass. 2. Let h denote the stationary mass of the Markov chain. Find h(x) for all x E S. 3. Show that the Markov chain has the steady state mass. 4. Let h* denote the steady state mass of the Markov chain. Find h*(x) for all x E S.Question 20 1 pts Let P be the transition matrix of a Markov chain with n states. Which one of the following statements is not always true? If Q is another transition matrix of a Markov chain with n states, then =(P + Q) is the transition matrix of a Markov chain with n states. O P2 is the transition matrix of a Markov chain with n states. If P is invertible, then p-1 is the transition matrix of a Markov chain with n states. If Q is another transition matrix of a Markov chain with n states, then PQ is the transition matrix of a Markov chain with n states.5. A Markov chain {X,, n 2 0} with state space { 1, 2, 3, 4, 5 } has the transition probability matrix given below. DO P = Ooouo ooouo OHOOO HOO OOH (a) Draw the transition diagram for this Markov chain. (b) Is this Markov chain irreducible? Explain. (c) Determine the period of each state in this Markov chain