Problem Statement:

$(1)$ Suppose that an agent is situated in the $4$x$3$ environment as shown in Figure $1.$

Beginning in the start state, it must choose an action at each time step. The interaction

with the environment terminates when the agent reaches one of the goal states, marked

$+1$ or $-1.$ We assume that the environment is fully observable, so that the agent always

knows where it is$.$ You may decide to take the following four actions in every state: Up$,$

Down, Left and Right. However, the environment is stochastic, that means the action

that you take may not

lead you to the desired

state.Problem Statement:

$(1)$ Suppose that an agent is situated in the $4$x$3$ environment as shown in Figure $1.$

Beginning in the start state, it must choose an action at each time step. The interaction

with the environment terminates when the agent reaches one of the goal states, marked

$+1$ or $-1.$ We assume that the environment is fully observable, so that the agent always

knows where it is$.$ You may decide to take the following four actions in every state: Up$,$

Down, Left and Right. However, the environment is stochastic, that means the action

that you take may not

lead you to the desired

state.