Question: 4. (a) Consider a linear regression problem , with a training set having m examples . Suppose that we wish to minimize the mean fifth

4. (a) Consider a linear regression problem 4. (a) Consider a linear regression problem , with a training set , with a training set having m examples having m examples . Suppose that we wish to minimize the mean . Suppose that we wish to minimize the mean fifth degree error (loss function) given by:

fifth degree error (loss function) given by: i. Derive the equation to

i. Derive the equation to calculate the gradient with respect to the parameters w1 and w0. (6 marks) ii. Write the pseudo-code of the gradient descent algorithm for this problem. (6 marks)

(b) Consider the following set of points: {(-2, -1), (1, 1), (3, 2)} i. Find the least square regression line for the given data points. (5 marks) ii. Plot the given points and the regression line in the same rectangular system of axes. (5 marks)

(c) What is the use of basis function in linear regression? (5 marks)

y = W10 + wo (21, y1), 12, y2), ..., Im, Ym) Loss = (u: ) y = W10 + wo (21, y1), 12, y2), ..., Im, Ym) Loss = (u: )

Step by Step Solution

There are 3 Steps involved in it

1 Expert Approved Answer
Step: 1 Unlock blur-text-image
Question Has Been Solved by an Expert!

Get step-by-step solutions from verified subject matter experts

Step: 2 Unlock
Step: 3 Unlock

Students Have Also Explored These Related Databases Questions!