Question: 4. Simulate the two-state Markov chain { {,, } in question 3, starting in state 1, with transition matrix Pil P12 P = P2 P22.

4. Simulate the two-state Markov chain { {,, } in question 3, starting in state 1, with transition matrix Pil P12 P = P2 P22. and cost matrix C12 0 C = (Cq)= C21 C22 Each transition from / to / incurs a cost of c . Obtain a confidence interval for the long-run average cost using p,, =1/3 and paz =3/4, with 1000 regeneration cycles. (18 points)
Step by Step Solution
There are 3 Steps involved in it
Get step-by-step solutions from verified subject matter experts
