Question: Gating 1 point possible ( graded ) Recall that the most simple, single - layered RNN can be written in equation as: Recognize that, in

Gating
1 point possible (graded)
Recall that the most simple, single-layered RNN can be written in equation as:
Recognize that, in the above formulation, is always overwritten with the calculated result .
Now, we introduce a gate vector of the same dimension as , which determines "how much information to overwrite in the next state." In equation, a single-layered gated RNN can be written as:
where the sign denotes element-wise multiplication. Now, which of the following is true about the gat

Step by Step Solution

There are 3 Steps involved in it

1 Expert Approved Answer
Step: 1 Unlock blur-text-image
Question Has Been Solved by an Expert!

Get step-by-step solutions from verified subject matter experts

Step: 2 Unlock
Step: 3 Unlock

Students Have Also Explored These Related Databases Questions!