Question: While training an artificial neural network, the loss doesn't decrease as you expect. What could be some of the reasons? You have trained a Neural

 While training an artificial neural network, the loss doesn't decrease as

While training an artificial neural network, the loss doesn't decrease as you expect. What could be some of the reasons? You have trained a Neural Network using Stochastic Gradient Descent (SGD) and L2 weight regularization with four different learning rates. The corresponding loss curves A,B,C, and D are shown below. Assign each of the learning rate value below to the proper curve (A/B/C/D). Explain why. Learn ing Rate s=[3e4,4e1,2e5,8e3]=[0.0003,0.4,0.00002,0.008]

Step by Step Solution

There are 3 Steps involved in it

1 Expert Approved Answer
Step: 1 Unlock blur-text-image
Question Has Been Solved by an Expert!

Get step-by-step solutions from verified subject matter experts

Step: 2 Unlock
Step: 3 Unlock

Students Have Also Explored These Related Databases Questions!