Solving Linear Regression using Gradient Descent x(1) X(2) x(3) X(4) X(5) 1.0 2.0 3.0 4.0 5.0...

  

Transcribed Image Text:

Solving Linear Regression using Gradient Descent x(1) X(2) x(3) X(4) X(5) 1.0 2.0 3.0 4.0 5.0 -2.0 -5.0 -6.0 -8.0 -11.0 2.0 4.0 7.0 8.0 11.0 Now, we want to implement the gradient descent method. I1 2 y Assuming that a = 0.1 and 0 has been initialized to [0, 0, 0], perform one iteration of gradient descent: a) What is the gradient of the objective function J(0) with respect to 8: Vėj(0)? b) How do we carry out the update rule? c) How could we pick which value of a to use if we weren't given the step size? Solving Linear Regression using Gradient Descent x(1) X(2) x(3) X(4) X(5) 1.0 2.0 3.0 4.0 5.0 -2.0 -5.0 -6.0 -8.0 -11.0 2.0 4.0 7.0 8.0 11.0 Now, we want to implement the gradient descent method. I1 2 y Assuming that a = 0.1 and 0 has been initialized to [0, 0, 0], perform one iteration of gradient descent: a) What is the gradient of the objective function J(0) with respect to 8: Vėj(0)? b) How do we carry out the update rule? c) How could we pick which value of a to use if we weren't given the step size?

Answer rating: 100% (QA)

It looks like youre asking about solving a linear regression problem using gradient descent Gradient descent is a firstorder iterative optimization al... View the full answer