Question: A While training an artificial neural network, the loss doesn't decrease as you expect. What could be some of the reasons? B> You have trained

 A While training an artificial neural network, the loss doesn't decrease

A While training an artificial neural network, the loss doesn't decrease as you expect. What could be some of the reasons? B> You have trained a Neural Network using Stochastic Gradient Descent (SGD) and L2 weight regularization with four different learning rates. The corresponding loss curves A, B, C, and D are shown below. Assign each of the learning rate value below to the proper curve (A/B/C/D). Explain why. Learning Rates =[3e4,4e1,2e5,8e3]=[0.0003,0.4,0.00002,0.008]

Step by Step Solution

There are 3 Steps involved in it

1 Expert Approved Answer
Step: 1 Unlock blur-text-image
Question Has Been Solved by an Expert!

Get step-by-step solutions from verified subject matter experts

Step: 2 Unlock
Step: 3 Unlock

Students Have Also Explored These Related Databases Questions!