Question: 2 a) A univariate linear regression model is given by: 7 he(x) = 60 + 01x Gradient descent algorithm is used to update the parameters,

 2 a) A univariate linear regression model is given by: 7

2 a) A univariate linear regression model is given by: 7 he(x) = 60 + 01x Gradient descent algorithm is used to update the parameters, and 01. Write down the gradient descent algorithm that is used to update the parameters. You should show how the parameters get updated. Make sure you evaluate the partial derivatives as well i.e. the final equations should not contain any partial derivatives. 3 b) One of the hyper-parameters in a gradient descent algorithm is the learning rate (a). Briefly explain the consequences of choosing a value of a that is i) ii) Too small Too large

Step by Step Solution

There are 3 Steps involved in it

1 Expert Approved Answer
Step: 1 Unlock blur-text-image
Question Has Been Solved by an Expert!

Get step-by-step solutions from verified subject matter experts

Step: 2 Unlock
Step: 3 Unlock

Students Have Also Explored These Related Databases Questions!