Q$2$ Value Iteration Convergence Values

Consider the gridworld where Left and Rightactions are successful $100\%$ of the time. Specifically, the available

actions in each state are to move to the neighboring grid squares. From state $a,$ there is also an exit action

available, which results in going to the terminal state and collecting a reward of $10.$ Similarly, in state $e,$ the

reward for the exit action is $1.$ Exit actions are successful $100\%$ of the time.

Let the discount factor $=0\mathrm{.}2.$ Fill in the following quantities.

$V^{*}(a)=V_{}(a)=1$

$V^{*}(b)=V_{}(b)=1$

$V^{*}(c)=V_{}(c)=1$

$V^{*}(d)=V_{}(d)=|$

$V^{*}(e)=V_{}(e)=1$