Question: Consider the function f ( x 1 , x 2 ) = ( 2 x 1 1 ) 4 + ( x 1 + x
Consider the function f x xxx x
a Find the global minimum of f and justify your answer.
b Starting at x perform gradient descent with backtracking line
search.
i Starting at x with stepsize, which is also called learning rate in
the machine learning community, write down the gradient descent
equation for x
ii Suppose we want to set using backtracking line search with
and Armijos condition f x f x f x
Find a
value of that satisfies this.
iii. Suppose instead you started with and an update of
ie
In the worst case, how many steps of backtracking would
you have to take before accepting x
Step by Step Solution
There are 3 Steps involved in it
1 Expert Approved Answer
Step: 1 Unlock
Question Has Been Solved by an Expert!
Get step-by-step solutions from verified subject matter experts
Step: 2 Unlock
Step: 3 Unlock
