Value Iteration for Markov Decision Process

$$ Bookmark this page

Homework due Aug $28,202417$:$29$ IST

Consider the following problem through the lens of a Markov Decision Process $($MDP$),$ and answer questions $1$

$3$ accordingly.

Damilola is a soccer player for the ML United under$-15$s who is debating whether to sign for the NLP Albion

youth team or the Computer Vision Wanderers youth team. After three years, signing for NLP Albion has two

possibilities: He will still be in the youth team, earning $10,000(60\%$ chance$),$ or he will make the senior team

and earn $70,000(40\%$ chance$).$ Lastly, he is assured of making the Computer Vision Wanderers senior team

after three years, with a salary of $37,000.$

Q$1$

$1$ point possible $($graded$)$

Given that Damilola only cares about having the highest expected salary after three years, $V^{*}($ML United under$-$

$15$ s$)$ is achieved through the action of signing for Computer Vision Wanderers.