Question: could you give me explanations on this problem ? I am stuck, and I do need your help. Thanks Consider a random walk over 3

could you give me explanations on this problem ? I am stuck, and I do need your help. Thanks

could you give me explanations on this problem ? I am stuck,

Consider a random walk over 3 webpages, 1, 2, 3. At any step, if the person is at webpage 1, then with probability 1/6, she will go to webpage 2, and with probability 1/6, she will go to webpage 3. If the person is at webpage 2, then with probability 1/2, she will go to webpage 1, and with probability 1/2, she will go to webpage 3. If the person is at webpage 3, then with probability 1/2, she will go to webpage 1, and with probability 1/2, she will go to webpage 2. Let Xt be the webpage the person is browsing at time t, and let us assume she starts from webpage 1 at time 0, i.e., Xo = 1. (1) Let Kij = P(Xt+1 = j|Xt = i). Let K = (Kij) be the 3 x 3 transition matrix. Write down K. (2) Let p. = P(Xt = i). Let p(t) = (p."), i = 1,2,3) be the row vector. Calculate p) for t = 1, 2, 3. Using concrete numbers, explain p(2) = p(1) K. (3) Let 7; be the stationary distribution at webpage i, so that nj = _;_Tikij. Let T = (mi, i= 1, 2, 3) be the row vector. Then 7 = TK. Given K, solve 7 from this equation. Is p3) close to ? (4) Based on the above calculations, answer the following questions. Suppose there are 1 million people doing the above random walk independently, and suppose they all start from webpage 1 at time t = 0. Then on average, what is the distribution of these 1 million people for t = 1, 2, 3? What is the stationary distribution of these 1 million people? Which page is the most popular

Step by Step Solution

There are 3 Steps involved in it

1 Expert Approved Answer
Step: 1 Unlock blur-text-image
Question Has Been Solved by an Expert!

Get step-by-step solutions from verified subject matter experts

Step: 2 Unlock
Step: 3 Unlock

Students Have Also Explored These Related Mathematics Questions!