Consider a simple random walk on the following graph. a. Suppose that the walker begins in state

Question:

Consider a simple random walk on the following graph.

a. Suppose that the walker begins in state 3. What is the expected number of visits to state 2 before the walker visits state 1?
b. Suppose again that the walker begins in state 3. What is the expected number of steps until the walker reaches state 1?
c. Now suppose that the walker starts in state 1. What is the probability that the walker reaches state 3 before reaching state 2?

Step by Step Answer:

Related Book For  answer-question

Linear Algebra And Its Applications

ISBN: 9781292351216

6th Global Edition

Authors: David Lay, Steven Lay, Judi McDonald

Question Posted: