Question: 8 . Recall that in backpropagation, for each network weight, weights are updated by geotriangle ji = j ji + momentum - term where

8. Recall that in backpropagation, for each network weight, weights are updated by
\geotriangle ji = j ji + momentum-term
where w ji is the weight from unit i to unit j, xji is the input coming from unit i to unit j, and j is the
error term at unit j.
(8a) Suppose you are training a multilayer neural network. You are about to update weight w ji .
Suppose you have the following values: Current value for weight w ji =0.1 xji =1
!=0.1
Previous value of \geotriangle ji =0.2
Learning rate \eta =0.1 Momentum
parameter \alpha =0.2 What is the new value
of w ji ?
(8b) In one sentence, what is the purpose of the momentum term?

Step by Step Solution

There are 3 Steps involved in it

1 Expert Approved Answer
Step: 1 Unlock blur-text-image
Question Has Been Solved by an Expert!

Get step-by-step solutions from verified subject matter experts

Step: 2 Unlock
Step: 3 Unlock

Students Have Also Explored These Related Programming Questions!