Consider an MDP with a single non$-$terminal state $($NT$)$ and two terminal states T$1$

and T$2,$ respectively. When in state NT$,$ the next state is NT itself with probability

$0\mathrm{.}6,$ T$1$ with probability $0\mathrm{.}2$ or T$2$ with probability $0\mathrm{.}2,$ respectively. If the transition

from NT is to either NT itself or to T$1,$ the single$-$stage reward is $1.$ On the other

hand, if the transition from NT is to T$2,$ the single$-$stage reward is $0.$ We observe two

episodes of this MDP both starting in state NT$.$ The first episode terminates in T$1$

and gives a total reward of $16.$ The second episode terminates in T$2$ and gives a total

reward of $6.$

$($a$)$ Write down both the episodes completely by writing the sequence of states visited

and the single$-$stage rewards obtained? $(2)$

$($b$)$ Write down the first visit and every visit estimates of the value of NT$?(2)$