$(20pts)$ When the learning rate is $0\mathrm{.}1,$ and the discount factor is $0\mathrm{.}9.$ Consider the

following trajectories.

$(s2,$ north, $s3,r=-0\mathrm{.}1)$;

$(s3,$ east, $s3,r=-0\mathrm{.}1)$;

$(s3,$ east, $s4,r=-0\mathrm{.}1)$;

$(s4,$ north, $s4,r=1\mathrm{.}0)$;