$($a$)]$ What do you perform in Policy Evaluation and Policy Improvement? How are they useful in estimating optimal policy? $|$ Answer must be phrased using formal, unambiguous statement$)$

$($b$)$ Provide a high$-$level algorithm for policy iteration. Use the computation of either action or state values Make necessary assumptions.

$($c$)$ Explain the characteristics of reinforcement learning problems for which a solution using dynamic programming is appropriate. Provide any two examples of problems.