$12$:$03$

stc ksa l$$

Assignment$\_2\_2025$

Question$3$: MDP

Let's consider the following $3-$state MDP for a robot trying to walk, the three states being 'Fallen', 'Standing' and 'Moving', as shown in the following figure:

Question: Show one value iteration $($V$1)$ for discount factor $=1.$