Question: How do we start this I dont understand it 1. multiple minima (5 pts.). We will explore the behavior of minimization algorithms for a simple

How do we start this I dont understand it

How do we start this I dont understand it 1. multiple minima

1. multiple minima (5 pts.). We will explore the behavior of minimization algorithms for a simple univariate case with multiple minima. Let L(a:) = 3:4 149:3 + 60932 7093. (a) Plot the loss function L over the set [1,8]. Is it convex? If yes, why? If no, are there regions where it is (locally) convex? (b) What do you expect the behavior of Nelder-Mead or Newton's method will be? (c) Use the NelderMead algorithm to nd the argument that minimizes L. Initialize your two points randomly in [0, 2]. Plot a vertical bar where the minimizer is, together with the function. Compare to the result of R's optim just for sanity check. (d) Keep track of the \"best\" NealderMead point at each iteration ($1) and make two plots showing this sequence. In the rst plot show the values Man) for di'erent iterations on top of the loss function L. In the second one plot the convergence behavior as in the plot of page 3, w07d1 notes. (e) Repeat the above two problems with initial two points in [6,8]. Explain your result

Step by Step Solution

There are 3 Steps involved in it

1 Expert Approved Answer
Step: 1 Unlock blur-text-image
Question Has Been Solved by an Expert!

Get step-by-step solutions from verified subject matter experts

Step: 2 Unlock
Step: 3 Unlock

Students Have Also Explored These Related Mathematics Questions!