$5)$Consider tic$-$tac$-$toe to answer this question. Assume that states are numbered from S$1$ to Sn$.$

a$)$List the four elements of reinforement learning and write one well$-$articulated formal statementexplaining the role of each element.

b$)$write the temporal difference rule for learning each state's value. Explain various elements and the workings of this rule.

c$)$Let the value of current state be $4\mathrm{.}5$ and all its possible successo$/$predecessor states have a value of $2\mathrm{.}7.$ Use $0\mathrm{.}9$ to be the parameter value for any parameter

you need to use to solve the problem. Give this revise estimate of the value of the current state using your answer to $($b$).$Explain your answer.