Consider the network below:

$($i$1-$h$2=$w$3=\mathrm{.}25,i2-h1=w2=\mathrm{.}20,h2-ol=\mathrm{.}45$ and $h1-o2=\mathrm{.}50)$

a$)$ The network uses sigmoid activation function. Compute the total error that has to be back

propagated through the network.

$[5]$

b$)$ Find the output at o$1$ and o$2$ if the activation function at the output layer is changed to

Relu? $[1]$

c$)$ Find the output of the network if a softmax layer is introduced after o$1,$ o$2$ layer?