Question: 2 a) A univariate linear regression model is given by: 7 he(x) = 60 + 01x Gradient descent algorithm is used to update the parameters,

2 a) A univariate linear regression model is given by: 7 he(x) = 60 + 01x Gradient descent algorithm is used to update the parameters, and 01. Write down the gradient descent algorithm that is used to update the parameters. You should show how the parameters get updated. Make sure you evaluate the partial derivatives as well i.e. the final equations should not contain any partial derivatives. 3 b) One of the hyper-parameters in a gradient descent algorithm is the learning rate (a). Briefly explain the consequences of choosing a value of a that is i) ii) Too small Too large
Step by Step Solution
There are 3 Steps involved in it
Get step-by-step solutions from verified subject matter experts
