Given $=0\mathrm{.}7,$ answer the following questions:

$P(s_3^c,r_3^c|s_2^b,a_2^3)=?$

$P(s_3^g,r_3^g|s_2^d,a_2^7)=?$

$P_{s_2^f{s}_3^k}^{a_2^{11}}=?$

$Q_{}(s_2^e,a_2^8)=?$

$Q_{}(s_1,a_1^1)=?$

$Q_{}(s_1,a_1^2)=?$

$Q_{}(s_1,a_1^3)=?$

$V_{}(s_1)=?$

$A_{}(s_1,a_1^1)=?$

$A_{}(s_1,a_1^2)=?$

$A_{}(s_1,a_1^3)=?$

Based on the A$-$function values you calculated,

briefly explain your strategy to update the policy in

order to achieve higher expected reward.

Using plain language $($no equation$),$ explain the

relations among V$-$function, Q$-$function, and A$-$

function, and why we need to consider A$-$function

to update the policy.