$($a$)$ How are rewards and returns connected?

$[1$ Mark$]$

$($b$)$ Consider the RL agent learning the game of tic$-$tac$-$toe, by playing against different randomly chosen opponents. Consider the temp

difference rule being used in this context. Can $$ be used to encourage exploration? $[1$ Mark$]$ Why or why not?

$[2$ Marks$]$

$V(S_t)larrV(S_t)+[V(S_{t+1})-V(S_t)]$

$($c$)$ Write one model$-$based and model$-$free algorithm for reinforcement learning covered in the course so far.

$[1+3+1=5$ Marks $]$

$[1$ Mark$]$