$3.(1)$

$2\mathrm{.}0$ points possible $($graded$,$ results hidden$)$

Define as the optimal value function of the state $.$ Compute via Bellman's Equation in terms of and $.$

$($Enter gamma for $.)$