Consider an unbiased random walk with reflecting boundaries on {1; 2; 3; 4}. a. Find the transition

Question:

Consider an unbiased random walk with reflecting boundaries on {1; 2; 3; 4}.
a. Find the transition matrix for the Markov chain and show that this matrix is not regular.
b. Assuming that the steady-state vector may be interpreted as occupation times for this Markov chain, in what state will this chain spend the most steps?

Fantastic news! We've Found the answer you've been seeking!

Step by Step Answer:

Related Book For  answer-question

Linear Algebra And Its Applications

ISBN: 9781292351216

6th Global Edition

Authors: David Lay, Steven Lay, Judi McDonald

Question Posted: