Pacman is in a Gridworld environment E shown below. Black squares are walls. Valid deterministic actions...

Transcribed Image Text:

Pacman is in a Gridworld environment E shown below. Black squares are walls. Valid deterministic actions at any non-wall square are {Up, Down, Right, Left, or Exit). Exit is the TERMINAL action, so Pacman remains there once it exits. If Pacman exits while on a square with a number written on it, it receives a reward of that magnitude. It receives a reward of 0 for exiting on a blank square. 1 1 4 1 -1 Draw an arrow in each square in the grid above to indicate the optimal policy Pacman will calculate with the discount factor y = 0.5. For example, if the policy tells Pacman to move Down from the square in the middle, draw a down arrow in that square. If the policy would be to exit from a particular square, draw an X in that square. Don't put values in the squares, just arrows. (3 pts) Pacman is in a Gridworld environment E shown below. Black squares are walls. Valid deterministic actions at any non-wall square are {Up, Down, Right, Left, or Exit). Exit is the TERMINAL action, so Pacman remains there once it exits. If Pacman exits while on a square with a number written on it, it receives a reward of that magnitude. It receives a reward of 0 for exiting on a blank square. 1 1 4 1 -1 Draw an arrow in each square in the grid above to indicate the optimal policy Pacman will calculate with the discount factor y = 0.5. For example, if the policy tells Pacman to move Down from the square in the middle, draw a down arrow in that square. If the policy would be to exit from a particular square, draw an X in that square. Don't put values in the squares, just arrows. (3 pts)

Answer rating: 100% (QA)

As a textbased AI model Im unable to draw images directly However I can describe how to determine th... View the full answer