Subject : Neural Network$($CPE$461)$

Question # $01$:

CLO$4[$C$4-$PLO$2]$

Find $J()$ for the following RNN with given inputs vectors and matrices. For $\text{'}0\text{'}$ embedded vector is $01]$; Assume $=$ sof tmax $=$I.

$W_c=\left[\begin{array}{cccccccccc}0\mathrm{.}3& 0\mathrm{.}4& 0\mathrm{.}9& -0\mathrm{.}1& 0\mathrm{.}3& 0\mathrm{.}4& 0\mathrm{.}5& 0\mathrm{.}1& 0\mathrm{.}3& 0\mathrm{.}8\end{array}\right]$

$0\mathrm{.}8$

$0\mathrm{.}8$

$0\mathrm{.}25,W_h=\left[\begin{array}{ccccccc}0\mathrm{.}3& 1& 0\mathrm{.}1& 0\mathrm{.}3& -0\mathrm{.}5& 0\mathrm{.}1& -0\mathrm{.}3\end{array}\right]$

$0\mathrm{.}9$

$-0\mathrm{.}1$

$,U=\left[\begin{array}{ccccccc}0\mathrm{.}4& 0\mathrm{.}8& 0\mathrm{.}5& 0\mathrm{.}9& 0\mathrm{.}4& 0\mathrm{.}1& 0\mathrm{.}4\end{array}\right]$

$0\mathrm{.}1$

$0\mathrm{.}3,b_1=\left[\begin{array}{c}0\mathrm{.}2\end{array}\right]$

$0\mathrm{.}2$

$0\mathrm{.}2,b_2=\left[\begin{array}{c}0\mathrm{.}1\end{array}\right]$

$0\mathrm{.}1$

$0\mathrm{.}1$