Question: Complete and submit solutions to the following problems. Use correct notation as presented in class for any probabilities you are determining for your answers. Ensure

Complete and submit solutions to the following problems. Use correct notation as presented in class for any probabilities you are determining for your answers. Ensure you fully characterize all Markov chain models. Show all your work in detail. Answers without supporting work may be severely penalized. 1. (5{_)pts)Consider a circular random walk in which six points 1, 2, 3, 4, 5, 6 are placed on a circle in clockwise order. Suppose that onestep transitions are possible only from one point to adjacent points with equal probabilities. (a) Draw a transition diagram and write a matrix for this Markov chain. (b) Starting from 3: nd the probability that in 5 transitions, the Markov chain enters 2. (c) What are the expected numbers of visits from 3 to all the state (including 3 itself) after 6 transitions? (d) What is the probability that state (i has not been visited after 3 transitions
Step by Step Solution
There are 3 Steps involved in it
Get step-by-step solutions from verified subject matter experts
