Question: Please help on this Applied Stochastic Processesquestion (12 points) In the following series of questions, we will study the stationary distribution of the simple symmetric

Please help on this Applied Stochastic Processesquestion

 Please help on this Applied Stochastic Processesquestion (12 points) In the

(12 points) In the following series of questions, we will study the stationary distribution of the simple symmetric random walk. For a Markov chain with transition matrix A, we know that to nd the stationary distribution one needs to solve the system of linear equations ATA = AT. The main difculty with simple symmetric random walk is that the state space is the set of all integers. Hence, one will have to deal with innite dimensional matrix and vector. However, you can overcome the challenge by following my guidance. (1). First consider a 3 x 3 transition matrix A with state space {1,2,3}. Denote by AT = (A1,)ng, A3) one stationary distributiOn. Show that A1, A2, and A3 satisfy A12A1 + (A22 1))\\2 + A32A3 = 0: (1) where A\"- means the element in the ith row and jth column of A. 5). Assume that the simple symmetric random walk has a stationary distribution wT = (. . . ,7r_2,7r_1,7r0,1r1,7r2, ....) Write down (1) for 11': curl + b7r2 + 6173 = 0 by replacing a, b, c with correct numbers. Make sure to justify your answer and write the above equality for general time steps: 75,4, 7r\

Step by Step Solution

There are 3 Steps involved in it

1 Expert Approved Answer
Step: 1 Unlock blur-text-image
Question Has Been Solved by an Expert!

Get step-by-step solutions from verified subject matter experts

Step: 2 Unlock
Step: 3 Unlock

Students Have Also Explored These Related Mathematics Questions!