Consider a multi$-$armed bandit problem, please provide the expected return of the actions below:

please explain in detail with each step of calculation and how it is calculated.Also explain the mathematics behind the calculation.

Action $1-$ Reward is always $5$

Value of action $1$ is q$*(1)=$

Action $2-45\%$ chance of reward is $0$ and $55\%$ chance of reward is $100$

Value of action $2$ is q$*(2)=$

Action $3-$ Randomly between $-10$ and $25,$ equiprobable

Value of action $3$ is q$*(3)=$

Action $4-$ A third chance of reward is $0,$ a third is $50$ and a third is from $\{8,9,10,...,18\}$

Value of action $4$ is q$*(4)=$