Question: Run gradient descent for 1 0 0 steps with constant step size = 1 / 4 . Compare two different initialization: initialization A w 1

Run gradient descent for 100 steps with constant step size =1/4. Compare two
different initialization: initialization A
w1=2.5, w2=3.56
and initialization B
w1=2.5, w2=3.57.
Answer the following questions:
1. Which initialization led to better performance in terms of the training error?
2. Is one of the converged final parameter (nearly) optimal? How do you know?

Step by Step Solution

There are 3 Steps involved in it

1 Expert Approved Answer
Step: 1 Unlock blur-text-image
Question Has Been Solved by an Expert!

Get step-by-step solutions from verified subject matter experts

Step: 2 Unlock
Step: 3 Unlock

Students Have Also Explored These Related Programming Questions!