Question: Assume that we are training a multivariate linear regression model using three instances as follows. instance id: , ( x 1 , x 2 )

Assume that we are training a multivariate linear regression model using three instances as follows.
instance id: ,(x1,x2), label y
instance 1:
instance 2: (-0.5,1),1
instance 3: (2,0.5),1
The cost function is based on mean squared error as follows.
min0,1,216i=13(h(x(i))-y(i))2.
Assume that we have initialized
w=[0,1,2]=[0,0.5,1].
You apply gradient descent algorithm to compute a w that minimizes the cost function w.r.t. the three
given instances. Assume that in the first iteration, we set learning rate =0.8. In the second iteration,
we set learning rate =0.4. Please concisely show how w is updated in the first and second iterations.
 Assume that we are training a multivariate linear regression model using

Step by Step Solution

There are 3 Steps involved in it

1 Expert Approved Answer
Step: 1 Unlock blur-text-image
Question Has Been Solved by an Expert!

Get step-by-step solutions from verified subject matter experts

Step: 2 Unlock
Step: 3 Unlock

Students Have Also Explored These Related Databases Questions!