Solve the problem

Problem 7.4 (10 points) A Markov chain Xo, X1, X2, ... with state space S = {1, 2,3, 4) has the following transition graph: 0.5 0.5 0.5 1 0.5 0.5 0.5 2 0.5 0.5 (a) Provide the transition matrix for the Markov chain. (b) Determine all recurrent and all transient states. (c) Determine all communication classes. Is the Markov chain irreducible? (d) Find the stationary distribution. (e) Can you say something about the limiting distribution of this Markov chain?It is 0.831999 Bivariate Fit of Happiness By LifeExpectancy Happiness un 40 45 50 55 60 65 70 80 85 LifeExpectancy Bivariate Normal Ellipse P=0950 Bivariate Normal Ellipse P=0990 Bivariate Normal Ellipse P=0.950 Variable Mean Std Dev Correlation Signit. Prob Number LifeExpectancy 67.83646 11.04193 0.631999 <.0001 happiness bivariate normal ellipse p="0.990" variable mean std dev correlation signit. prob number lifeexpectancy can we conclude that being happier causes people to live longer explain. pts fact the f usually bows away from origin implies ii getting more of one good means another good. as production any increases. there is an increase in opportunity cost producing it. less good- a decrease problem points markov chain x0 x2 . with state space s="{1," has following transition graph: provide matrix fer chain. determine all recurrent and transient states>