Question: 8 . Recall that in backpropagation, for each network weight, weights are updated by geotriangle ji = j ji + momentum - term where
Recall that in backpropagation, for each network weight, weights are updated by
geotriangle ji j ji momentumterm
where w ji is the weight from unit i to unit j xji is the input coming from unit i to unit j and j is the
error term at unit j
a Suppose you are training a multilayer neural network. You are about to update weight w ji
Suppose you have the following values: Current value for weight w ji xji
Previous value of geotriangle ji
Learning rate eta Momentum
parameter alpha What is the new value
of w ji
b In one sentence, what is the purpose of the momentum term?
Step by Step Solution
There are 3 Steps involved in it
1 Expert Approved Answer
Step: 1 Unlock
Question Has Been Solved by an Expert!
Get step-by-step solutions from verified subject matter experts
Step: 2 Unlock
Step: 3 Unlock
