Problem 1 [50 points]: Consider the following optimization problem where mi nf x,y z ) x...
Fantastic news! We've Found the answer you've been seeking!
Question:
Transcribed Image Text:
Problem 1 [50 points]: Consider the following optimization problem where mi nf x,y z ) x y z f (x, y, z) = (x-2)+ 10(y-3) + (z - 1) It is obvious that the solution to the above optimization problem is (xyz) = (2,3,1). The goal of this exercise is to demonstrate that gradient descent (GD) converges to the above solution. a) [written, 5 pts] Let a = 0.01, with initial guess of (x oy 0, 0) = (1,2,2), find (x1,y 1, z 1), (x 2y 2, z 2), and (x 3,y 3, z 3). What is the value of the function f (x,y,z) at (x 0, y 0, 0),(x1,y 1, 1), (x 2 y 2,2 2), and (x 3, 3, z 3)? Is GD improving the candidate solution after each iteration? b) [written, 5 pts] Repeat a) with a = 0.025 c) [written, 5 pts] Repeat a) with a = 0.1 d) [written, 5 pts] From parts a)-c), what is the effect of changing the learning rate a? e) [programming, 20 pts] For the same initial guess in part a), for each of the above learning rates, implement the GD to find the optimal solution of the above optimization problem with error criterion If (x n, y n, z n ) - f (xn1, y n-1,2 n-1) < 108. For each a, what is the required number of iterations ? If the algorithm diverges, you may stop and state that it does not converge. f) [written, 10 pts] Analytically, verify that Vf (2,3,1) = [000] Problem 1 [50 points]: Consider the following optimization problem where mi nf x,y z ) x y z f (x, y, z) = (x-2)+ 10(y-3) + (z - 1) It is obvious that the solution to the above optimization problem is (xyz) = (2,3,1). The goal of this exercise is to demonstrate that gradient descent (GD) converges to the above solution. a) [written, 5 pts] Let a = 0.01, with initial guess of (x oy 0, 0) = (1,2,2), find (x1,y 1, z 1), (x 2y 2, z 2), and (x 3,y 3, z 3). What is the value of the function f (x,y,z) at (x 0, y 0, 0),(x1,y 1, 1), (x 2 y 2,2 2), and (x 3, 3, z 3)? Is GD improving the candidate solution after each iteration? b) [written, 5 pts] Repeat a) with a = 0.025 c) [written, 5 pts] Repeat a) with a = 0.1 d) [written, 5 pts] From parts a)-c), what is the effect of changing the learning rate a? e) [programming, 20 pts] For the same initial guess in part a), for each of the above learning rates, implement the GD to find the optimal solution of the above optimization problem with error criterion If (x n, y n, z n ) - f (xn1, y n-1,2 n-1) < 108. For each a, what is the required number of iterations ? If the algorithm diverges, you may stop and state that it does not converge. f) [written, 10 pts] Analytically, verify that Vf (2,3,1) = [000]
Expert Answer:
Related Book For
Posted Date:
Students also viewed these programming questions
-
Q1. You have identified a market opportunity for home media players that would cater for older members of the population. Many older people have difficulty in understanding the operating principles...
-
CANMNMM January of this year. (a) Each item will be held in a record. Describe all the data structures that must refer to these records to implement the required functionality. Describe all the...
-
Maynard Appliances is holding a Fifty- Fifty Sale. Major appliances may be purchased for nothing down and no interest to pay if the customer pays 50% of the purchase price in six months and the...
-
What is the constructive receipt doctrine? What types of taxpayers does this doctrine generally affect? For what tax planning strategy is the constructive receipt doctrine a potential limitation?
-
IT sourcing and cloud strategy, compare and contrast the sourcing approaches. Identify the factors that were important in each sourcing strategy and whether the sourcing decision was strategic for...
-
The two steel channels are to be laced together to form a 30 -ft-long bridge column assumed to be pin connected at its ends. Each channel has a cross-sectional area of \(A=3.10 \mathrm{in}^{2}\) and...
-
You have been asked to make a presentation in your Inter- national Business class about how globalization is impacting the auditing profession. In preparation, you met with your auditing professor...
-
What is a 3-way match? Part 2: Why is the 3-way match considered an internal control? Part 3: Who is responsible for performing the 3-way match, the Purchasing department, the Receiving department,...
-
Identify the stakeholders involved in LCSP development.
-
You flip a coin seven times and keep a record of the results. In how many ways could you obtain at least one tail?
-
Use a calculator to evaluate an ordinary annuity formula \[A=m\left[\frac{\left(1+\frac{r}{n}ight)^{n t}-1}{\frac{r}{n}}ight]\] for \(m, r\), and \(t\) (respectively) given in Problems 7-22. Assume...
-
What is a special purpose entity?
-
Use a calculator to evaluate the amortization formula \[m=\frac{P\left(\frac{r}{n}ight)}{1-\left(1+\frac{r}{n}ight)^{-n t}}\] for the values of the variables \(P, r\), and \(t\) (respectively) given...
-
Use a calculator to evaluate an ordinary annuity formula \[A=m\left[\frac{\left(1+\frac{r}{n}ight)^{n t}-1}{\frac{r}{n}}ight]\] for \(m, r\), and \(t\) (respectively) given in Problems 7-22. Assume...
-
Given a 1st order process with a disturbance (no change in setpoint) and using a PI controller, determine: A) if there will be any offset to a step load disturbance, and (7 points) B) the limits of...
-
Per Bag Direct materials: 25 pounds of CWhiz-2000 @ $0.08/lb. = $ 2.00 Direct labor: 0.05 hour @ $32.00/hr. = $ 1.60 The company manufactured 100,000 bags of Cheese-Be-Good in December and used...
-
Let S be the part of the sphere x 2 + y 2 + z 2 = 25 that lies above the plane z = 4. If S has constant density k, find (a) the center of mass and (b) the moment of inertia about the z-axis.
-
(a) Define the gradient vector f for a function f of two or three variables. (b) Express D u f in terms of f . (c) Explain the geometric significance of the gradient.
-
Evaluate the double integral. (2x + y) dA, D = {(x, y) | 1 < y < 2, y 1 < x < 1}
-
As the marketing manager for Independent Packaging Pty Ltd, you have asked the accountant what it costs to make the Container2000 model because you want to set a price for the container. A similar...
-
Incomplete information concerning the financial performance of two manufacturing companies is presented below. Required Determine the answers to (a) to(f) for the two companies. Work in process,...
-
Smart Manufacturing Systems Pty Ltd uses a periodic inventory system and closes its accounts on 30 June each year. The companys closing entries made on 30 June 2025 were as shown below. Required (a)...
Study smarter with the SolutionInn App