onsider the following Markov Decision Process $($MDP$)$: MDP with $4$ states $($rewards for each action are indicated on the arrow$)$ There are $4$ states A$,$ B$,$ C$,$ and D$.$ We can move up or down from states B and C$,$ but only up for A and only down for D$.$ Note that the discount factor $,$ and that this MDP is deterministic i$.$e$.$ if you choose action UP$,$ you are guaranteed to move UP$,$ and likewise for action DOWN.