Question: send to expert Given a 4 length sequence RNN , compute d e l L 2 d e l b and show how you derived

send to expert Given a 4 length sequence RNN, compute delL2delb and show how you derived it. In
addition, please provide its computation graph.
The following equations might be helpful:
at=Uxt+Wht-1+b
ht=tanh(at)
ot=Vhht+c
hat(y)t=Softmax(ot)
Lt=CE(hat(y)t,yt)
f(x)=tanh(x)longrightarrowf'(x)=1-tanh2(x)
Hint: You can combine softmax and CE into a single derivative as follows:
delLtdelot=hat(y)t-yt
 send to expert Given a 4 length sequence RNN, compute delL2delb

Step by Step Solution

There are 3 Steps involved in it

1 Expert Approved Answer
Step: 1 Unlock blur-text-image
Question Has Been Solved by an Expert!

Get step-by-step solutions from verified subject matter experts

Step: 2 Unlock
Step: 3 Unlock

Students Have Also Explored These Related Databases Questions!