$[18$ points$]$ Perform Q$-$learning for a system with two states and two actions, given the following training examples. The discount factor is $=0\mathrm{.}5$ and the learning rate is $=0\mathrm{.}5.$ Assume that your Q$-$table is initialized to $0$ for all values. $($The four steps below are sequential instead of separate$)$

points