Now it is time to complement value iteration.

$V_{k+1}(s)larrma{x}_a{\displaystyle \underset{s^{\text{'}}}{\overset{?}{}}}T(s,a,s^{\text{'}})[R(s,a,s^{\text{'}})+V_k(s^{\text{'}})]$

This time, the provided problems do not include policies:$\{$:$[-,$ bar$(-),-1],[$ bar$($s$),-,-1],[,-,-]$:$\}$

As usual, load the problem definition in the function read$\_$grid$\_$mdp$\_$problem$\_$p$3($file$\_$path$)$ of the file

parse.py$.$

Next implement value iteration$($problem$)$ in

p$3.$py such that it returns the following string for the first test case. Note that this is still a non$-$deterministic environment $($i$.$e$.,$ the taken action can be different from the intended one$)$ as before with the same stochastic motion.

Once you are done. Check if you can pass all test cases as follows.