For a Markov Decision Problem an agent is in the $5$X$5$ environment as shown in figure $1.$ The transition model of the environment is shown in figure $2.$ The intended outcome occurs with probability $0\mathrm{.}8,$ but with probability $0\mathrm{.}1$ the agent moves at right angles to the intended direction. For each state four actions $($up$,$ down, left, right$)$ are available. A collision with a wall results in no movement. S$04,$ S$12,$ S$23$ and S$42$ are terminal states with value$/$ rewards $10,-2,8$ and $6$ respectively. S$11,$ S$13,$ S$14,$ S$24,$ S$31,$ S$32,$ S$33,$ S$34,$ S$43,$ S$44$ are blocked states and cannot be reached. The reward for each action is r $=-0\mathrm{.}5.$ The discount factor d $=0\mathrm{.}9($or $\backslash$gamma $=0\mathrm{.}9).$