Q2 Value Iteration Convergence Values Consider the gridworld where Left and Right actions are successful 100% of the time. Specically, the available actions in each state are to move to the neighboring grid squares. From state a, there is also an exit action available, which results in going to the terminal state and collecting a reward of 10. Similarly, in state 9, the reward for the exit action is 1. Exit actions are successful 100% of the time