c$.(7$pt$)$ Assuming that the initial state values are all zeros, compute the updates in TD learning for policy evaluation $($passive $RL)$ to the $V$ function after running through episodes $1-3$ in sequence $($the episodes follow the policy to be evaluated$).$ Show steps for $=0\mathrm{.}5$ and $=1\mathrm{.}0.$

d$.(7$pt$)$ Assuming that the initial $Q$ values are all zeros, compute the updates in $Q$ learning $($active $RL)$ to the $Q$ values after running through episodes $1-3$ in sequence. Show steps for $=0\mathrm{.}5$ and $=1\mathrm{.}0.$