Question: I need help with this proof procedure. 3. (12 points) In the following series of questions, we will study the stationary distribution of the simple
I need help with this proof procedure.


3. (12 points) In the following series of questions, we will study the stationary distribution of the simple symmetric random walk. For a Markov chain with transition matrix A, we know that to find the stationary distribution one needs to solve the system of linear equations AT A = XT The main difficulty with simple symmetric random walk is that the state space is the set of all integers. Hence, one will have to deal with infinite dimensional matrix and vector. However, you can overcome the challenge by following my guidance. (1). First consider a 3 x 3 transition matrix A with state space {1, 2, 3}. Denote by 1? = (X1, 12, 13) one stationary distribution. Show that A1, 12, and 13 satisfy A121 + (A22 - 1)12 + A3213 = 0, (1) where Adj means the element in the ith row and jth column of A.(2). Assume that the simple symmetric random walk has a stationary distribution WT = (...,7r_2,7r_1,7ro,7r1,7r2,...). Write down (1) for 7r: our] +b7r2 +c1r3 =0 by replacing a, b, c with correct numbers. Make sure to justify your answer and write the above equality for general time steps: W1, 1r\
Step by Step Solution
There are 3 Steps involved in it
Get step-by-step solutions from verified subject matter experts
