Question: could you give me explanations on this problem ? I am stuck, and I do need your help. Thanks Consider a random walk over 3
could you give me explanations on this problem ? I am stuck, and I do need your help. Thanks

Consider a random walk over 3 webpages, 1, 2, 3. At any step, if the person is at webpage 1, then with probability 1/6, she will go to webpage 2, and with probability 1/6, she will go to webpage 3. If the person is at webpage 2, then with probability 1/2, she will go to webpage 1, and with probability 1/2, she will go to webpage 3. If the person is at webpage 3, then with probability 1/2, she will go to webpage 1, and with probability 1/2, she will go to webpage 2. Let Xt be the webpage the person is browsing at time t, and let us assume she starts from webpage 1 at time 0, i.e., Xo = 1. (1) Let Kij = P(Xt+1 = j|Xt = i). Let K = (Kij) be the 3 x 3 transition matrix. Write down K. (2) Let p. = P(Xt = i). Let p(t) = (p."), i = 1,2,3) be the row vector. Calculate p) for t = 1, 2, 3. Using concrete numbers, explain p(2) = p(1) K. (3) Let 7; be the stationary distribution at webpage i, so that nj = _;_Tikij. Let T = (mi, i= 1, 2, 3) be the row vector. Then 7 = TK. Given K, solve 7 from this equation. Is p3) close to ? (4) Based on the above calculations, answer the following questions. Suppose there are 1 million people doing the above random walk independently, and suppose they all start from webpage 1 at time t = 0. Then on average, what is the distribution of these 1 million people for t = 1, 2, 3? What is the stationary distribution of these 1 million people? Which page is the most popular
Step by Step Solution
There are 3 Steps involved in it
Get step-by-step solutions from verified subject matter experts
