Q$1\mathrm{.}1.(18$ points$)$ Consider running value iteration in grid world G$.$ Assume all legal movement actions will always succeed $($and so the state transition function is deterministic$).1.$ What is the smallest iteration k for which Vk$($A$)>0?$ For this smallest iteration k$,$ what is the value of Vk$($A$)?2.$ What is the smallest iteration k for which Vk$($B$)>0?$ For this smallest iteration k$,$ what is the value of Vk$($B$)?3.$ What is the smallest iteration k for which Vk$($A$)=$ V $($A$)?$ What is the value of V $($A$)?4.$ What is the smallest iteration k for which Vk$($B$)=$ V $($B$)?$ What is the value of V $($B$)?$