Question: Assume a simple recurrent neural network architecture as shown below. This network has two input neurons, three ReLUs in the hidden layer, and two ReLUs


Assume a simple recurrent neural network architecture as shown below. This network has two input neurons, three ReLUs in the hidden layer, and two ReLUs in the output layer. Also, all the bias terms in the network are equal to 0.1, and the weight matrices of the network (excluding bias terms) are listed below. Whx0.070.040.050.050.10.05Whh0.220.040.090.10.0900.050.060.08Wh[0.060.060.010.130.180.14] (a) If xt=[1,0.5] and ht1=[0.05,0.2,0.15], calculate the value of yt. (b) Assuming that the target output for time tt=[0,1], calculate the value for each neuron in the network
Step by Step Solution
There are 3 Steps involved in it
Get step-by-step solutions from verified subject matter experts
