$($a$)$ Recollect the recycling robot example whose transition diagram is as below:

B$5$

interpreting the transition diagram.

$($b$)$ Imagine that you are designing a robot to run a maze. You decide to give it a reward of $4$ for escaping from the maze and a reward of treat it as an episodic task, where the goal is to maximize expected total reward. After running the learning agent for a while, you find that it is showing no improvement in escaping from the maze. What is going wrong? How to fix the situation? $[3$ Marks$]$