For the MDP above

$($

same as the one we had in class

$)$

$,$

$$we randomly selected a policy and generated four

$($

$4$

$)$

$$episode$.$

What will be the values after each episode if we use the Model

$-$

free Monte Carlo method. You should write down the two

$($

$2$

$)$

$$utility values for each question.

$($

VAns

$($

sans

$)$

$=$

$?$

$$and VQuit

$($

squit

$)$

$=$

$?$

$)$

$.$