Question Three. A boy is being chased around the school yard by bullies and must choose whether to Fight or Run. There are three states:

$-$ Ok $($O$),$ where he is fine for the moment.

$-$ Danger $($D$),$ where the bullies are right on his heels.

$-$ Caught $($C$),$ where the bullies catch up with him and administer noogies.

$-$ He begins in state O $\backslash (75\backslash \%\backslash )$ of the time.

$-$ He begins in state D $\backslash (25\backslash \%\backslash )$ of the time.

The graph of the MDP is given here:

Fill out the table with the results of MDP value iteration with a discount factor $\backslash (=0\mathrm{.}9\backslash )$ : $(4$ points$)$

Show your solution down here: