Exercise $1\mathrm{.}2(12$pt$)$

Consider the $3$ x $3$ world shown below. The transition model is the same as in our robot domain: $80\%$ of

the

Hide Image Transcript

Exercise $1\mathrm{.}2(12$pt$)$ Consider the $3$ x $3$ world shown below. The transition model is the same as in our robot domain: $80\%$ of the time the agent goes in the direction it selects; the rest of the time it moves at right angles to the intended direction. $-10$ Use discounted rewards with a discount factor of $0\mathrm{.}99.$ Show the policy obtained in each case. Explain intuitively why the value of r leads to each policy $($no need to perform value or policy iteration$).$ a$.$ r$=100$ b$.$r$=-3$ c$.$ r$=0$ d$.$ r$=+3$