Question: I can hardly understand this question , could you please help me out? Thank you (the problem is attached below) Consider a DTMC { Xn,
I can hardly understand this question , could you please help me out? Thank you
(the problem is attached below)


Consider a DTMC { Xn, n ( N } with the state space S = {1, 2,3} and the one-step TPM 2 3 0.5 0.5 0 P = 2 0.25 0.5 0.25 3 0 0.5 0.5 Assume that the DTMC has the same initial probability to start either in state 1 or state 3 and that it is not possible to start in state 2.Find the probability function of X3. Show that this is an irreducible Markov chain and find the period of each state. Calculate P(X.;. = 1 , X? = 2, X4 = SIX; 2 1 , X1: 2)
Step by Step Solution
There are 3 Steps involved in it
Get step-by-step solutions from verified subject matter experts
