Let $()$ be the value function for Ghost. Pacman and Ghost have identical transition, reward functions, and

action space. $($Discounting is applied for Pacman$$s actions$)$

Derive the new Bellman equation for $()$ in terms of $,,,$ and $$:

$()=()()()[()()()[()()]]$

For each blank $($a$)$ through $($h$),$ mark the appropriate subexpression. If it is possible to write the expression for

$()$ without a particular sub$-$expression, mark "None".