Given the following neural network with fully connection layer and ReLU activations, including tw units $(11,12),$ four hidden units $($h$1,$ h$2)$ and $($h$3,$ h$4).$ The output units are indicated as $(01,02)$ and their targets are indicated as $($t$1,$ t$2).$ The weights and bias of fully connected layer are called w and b with specific sub$-$descriptors.

bi

b$3$

$21$

W$11$

h$1$

ReLU$-$ h$3$

W$31-$

$01$

w$32$

W$12.$

W$41$

W$21$

W$22$

h$2$

ReLU ha

$$W$42$

$02$

$22$

The values of variables are given in the following table:

Variable i Value

i$2$ W$11$ W$12$ W$21$ W$22$ W$31$ W$32$ W$41$ W$42$ b$1$ ba t$1$ t$22\mathrm{.}0-1\mathrm{.}01\mathrm{.}0-0\mathrm{.}50\mathrm{.}5-1\mathrm{.}00\mathrm{.}5-1\mathrm{.}0-0\mathrm{.}51\mathrm{.}00\mathrm{.}5-0\mathrm{.}5-1\mathrm{.}00\mathrm{.}51\mathrm{.}00\mathrm{.}5$

b$2.$

compute output $($o$1,$o$2)$ with the input $($i$1,$i$2)$ and network pamters as specified above. Write down all calculations, including intermediate layer results.