(10 points) Consider the gridworld where Left and Right actions are successful 100\% of the time. Specifically, the available actions in each state are to move to the neighboring grid squares. From state a, there is also an exit action available, which results in going to the terminal state and collecting a reward of 10. Similarly, in state e, the reward for the exit action is 1. Exit actions are successful 100% of the time. The discount factor () is 1 . 3.a. (5 points) Consider the policy 1 shown below, and evaluate the following quantities for this policy. Calculate V1(a),V1(b),V1(c),V1(d),V1(e), 3.b. (5 points) Consider the policy 2 shown below, and evaluate the following quantities for this policy. Calculate V2(a),V2(b),V2(c),V2(d),V2(e)