Consider the three state MDP for a robot trying to walk. The three states of the robot are $$Fallen$,$Standing$,$ and $$Moving$.$ In each of the states the robot can take either a slow or a fast action, denoted by black and green arrows, respectively. The slow action is more likely to keep the robot upright, but the fast action enables the robot to gain more distance.