Question: This question is about convergence. All the unconstrained optimization methods we have seen are iterative schemes that can be defined as follows: xk+1=G(xk) for some

 This question is about convergence. All the unconstrained optimization methods we

This question is about convergence. All the unconstrained optimization methods we have seen are iterative schemes that can be defined as follows: xk+1=G(xk) for some function G:RnRn. For example, for the steepest descent method with fixed step size , we have G(xk)=xk+(f(xk)). A fixed-point of such an iterative scheme is any point x satisfying x=G(x) We define the error as we have seen in class: e(xk)=xkx=G(xk1)x (as usual, the norm is the 2-norm). In this question we are interested in the question of the convergence of such a scheme to a fixed-point, or equivalently the convergence of e to 0 . We first look (questions 1,2,3 ) at what happens when n=1, i.e. x is actually a scalar x and G:RR; you have seen such iterative schemes in Calc I, for example the Newton method to find the zero of f. 2. Using Taylor expansion (you can disregard the o(.)term)aroundx, find which condition G(x) needs to satisfy in order that we have linear convergence. What is the rate of convergence then? This question is about convergence. All the unconstrained optimization methods we have seen are iterative schemes that can be defined as follows: xk+1=G(xk) for some function G:RnRn. For example, for the steepest descent method with fixed step size , we have G(xk)=xk+(f(xk)). A fixed-point of such an iterative scheme is any point x satisfying x=G(x) We define the error as we have seen in class: e(xk)=xkx=G(xk1)x (as usual, the norm is the 2-norm). In this question we are interested in the question of the convergence of such a scheme to a fixed-point, or equivalently the convergence of e to 0 . We first look (questions 1,2,3 ) at what happens when n=1, i.e. x is actually a scalar x and G:RR; you have seen such iterative schemes in Calc I, for example the Newton method to find the zero of f. 2. Using Taylor expansion (you can disregard the o(.)term)aroundx, find which condition G(x) needs to satisfy in order that we have linear convergence. What is the rate of convergence then

Step by Step Solution

There are 3 Steps involved in it

1 Expert Approved Answer
Step: 1 Unlock blur-text-image
Question Has Been Solved by an Expert!

Get step-by-step solutions from verified subject matter experts

Step: 2 Unlock
Step: 3 Unlock

Students Have Also Explored These Related Accounting Questions!