A simple maze below: reward is always $0$ until reaching the goal $($reward $=1).$

With a certain discount factor $($you decide$),$ please provide the Q learning formula and

parameters you are using.

A true $V$ value table is your final answer $($there is no need to provide a step$-$by$-$step visit

of the trial$).$

actions