Question: In this exercise you will have to code a simple version of gradient descent using Python. Take a screenshot of your code and results or

 In this exercise you will have to code a simple version

In this exercise you will have to code a simple version of gradient descent using Python. Take a screenshot of your code and results or attach it. (a) The objective function, the function you are going to use in your optimization problem, is f(x)=3x25x+10. Compute for which values of L is this function L-smooth and the minimum of f(x). (b) Implement gradient descent with initial condition x0=5 and fixed stepsize equal to 2 and run the algorithm for 20 iterations. What is the final iterate? (c) Implement gradient descent with initial condition x0=5 and fixed stepsize equal to 1/6 and run the algorithm for 20 iterations. What is the final iterate? (d) Implement gradient descent with initial condition x0=5 and fixed stepsize equal to 102 and run the algorithm for 100 iterations. What is the final iterate? (e) What is your conclusion about the previous questions

Step by Step Solution

There are 3 Steps involved in it

1 Expert Approved Answer
Step: 1 Unlock blur-text-image
Question Has Been Solved by an Expert!

Get step-by-step solutions from verified subject matter experts

Step: 2 Unlock
Step: 3 Unlock

Students Have Also Explored These Related Databases Questions!