Consider the following grid world in which you will implement TD learning and Q$-$learning techniques to find the values of these states.

Suppose that we have the following observed transitions: H $($A$,$ East, C$,3),($C$,$ South, B$,4),($C$,$ East, G$,1),($C$,$ East, E$,5),($E$,$ North, D$,3),\backslash (($E $\backslash ),$ North, $\backslash ($ F$,6),($E$,$ N o r t h$,$ H$,4)\backslash )$ The initial value of each state is $0.$ Assume that $\backslash (\backslash$mathrm$\{$y$\}=1\backslash )$ and $\backslash (\backslash$alpha$=0\mathrm{.}5\backslash ).$

$($a$)$ What are the learned values from TD learning after all seven observations?

$($b$)$ What are the learned Q$-$values from Q$-$learning after all seven observations?