Question: Run gradient descent to minimize the functiong(w) = 1 50 w 4 + w 2 + 10w (3.44) with an initial point w 0 =

Run gradient descent to minimize the functiong(w) = 1 50 w 4 + w 2 + 10w (3.44) with an initial point w 0 = 2 and 1000 iterations. Make three separate runs using each of the steplength values = 1, = 10-1 , and = 10-2 . Compute the derivative of this function by hand, and implement it (as well as the function itself) in Python using NumPy. Plot the resulting cost function history plot of each run in a single figure to compare their performance. Which steplength value works best for this particular function and initial point

Step by Step Solution

There are 3 Steps involved in it

1 Expert Approved Answer

Step: 1 Unlock blur-text-image

Question Has Been Solved by an Expert!

Get step-by-step solutions from verified subject matter experts

Step: 2 Unlock

Step: 3 Unlock

Students Have Also Explored These Related Mathematics Questions!

Run gradient descent to minimize the functiong(w) = 1 50 w 4 + w 2 + 10w with an initial point w 0 = 2 and 1000 iterations. Make three separate runs using each of the steplength values = 1, = 10-1 ,...

In this task, you will need to implement linear regression and get to see it work on data. For the starter, you will n eed to download the starter code and unzip its contents to the directory where...

Read about automatic differentation in "Machine Learning Defined" appendix B. You can find that online here https://jermwatt.github.io/machine learning refinedotes/3 First order methods/3 5...

Implement gradient descent with an initial iterate of all zeros. Using the gradients wJ(w,b),bJ(w,b), which are derived in Question 4 of the writing part, complete the following functions, i.e.,...

Jupiter Notebook We have covered some of the limitations of single layer neural networks in class, but they are still powerful learning systems that provide a good way to begin learning about how to...

ML in a nutshell Optimization, and machine learning, are intimately connected. At a very coarse level, ML works as follows. First, you come up somehow with a very complicated model y = M(x, 0), which...

Modify your 'gradient descent assignment I ' code in order to train the single hidden layer feedforward neural network ( FFNN ) discussed in class. You must use the same code to build your training...

Large data sets 2 points possible (graded) When a data set is large, we would ideally want to split up our loss function into a sum of individual loss functions for each data point: f (w) = If. (w),...

#MachineLearning #GradientDescentProgramming #Python Here is the code I have so far: w = np.random.normal(0,1,10) norm = np.linalg.norm(w) norm_w = worm #Generating random data for x, y def...

Refer to the Century National Bank data. Is it reasonable that the distribution of checking account balances approximates a normal probability distribution? Determine the mean and the standard...

Two multinational FIs enter their respective debt markets to issue $100 million of two-year notes. FI A can borrow at a fixed annual rate of 11 percent or a floating rate of LIBOR plus 50 basis...

6. In a LINQ statement, the clause limits the records that will be selected. a. Limit b. Order By c. Select d. Where

C program that takes one command line argument: the fully qualified name of a folder. The program creates two children processes. The first child process checks whether the input folder name already...