Question: A recurrent network has a single hidden layer, H = ( h 1 ; h 2 ; h 3 ) , which uses an ReLU

A recurrent network has a single hidden layer, H=(h1;h2;h3), which uses an ReLU activation
function. At time t, the activation levels of these three neurons are (2,8,3), respectively. At time t+1,
their activations are (4,1,6). Weights w1,3=0.4 and w2,3=0.5 are on the recurrent connections
from h1 to h3, and h2 to h3, respectively. Compute the following values:
a.delh3,t+1delw2,3=?
b.delh3,t+1delh1,t=?
A recurrent network has a single hidden layer, H

Step by Step Solution

There are 3 Steps involved in it

1 Expert Approved Answer
Step: 1 Unlock blur-text-image
Question Has Been Solved by an Expert!

Get step-by-step solutions from verified subject matter experts

Step: 2 Unlock
Step: 3 Unlock

Students Have Also Explored These Related Accounting Questions!