Question: In this exercise you will have to code a simple version of gradient descent using Python. Take a screenshot of your code and results or

In this exercise you will have to code a simple version of gradient descent using Python. Take a screenshot of your code and results or attach it. (a) The objective function, the function you are going to use in your optimization problem, is f(x)=3x25x+10. Compute for which values of L is this function L-smooth and the minimum of f(x). (b) Implement gradient descent with initial condition x0=5 and fixed stepsize equal to 2 and run the algorithm for 20 iterations. What is the final iterate? (c) Implement gradient descent with initial condition x0=5 and fixed stepsize equal to 1/6 and run the algorithm for 20 iterations. What is the final iterate? (d) Implement gradient descent with initial condition x0=5 and fixed stepsize equal to 102 and run the algorithm for 100 iterations. What is the final iterate? (e) What is your conclusion about the previous questions
Step by Step Solution
There are 3 Steps involved in it
Get step-by-step solutions from verified subject matter experts
