Write a function linear regression that fits a linear regression model, and takes the following two...

Transcribed Image Text:

Write a function linear regression that fits a linear regression model, and takes the following two arguments as input: 1. x: A numpy array of the shape (N,d) where N is the number of data points, and d is the data dimension. Do not assume anything about N or d other than being a positive integer. 2. Y: A numpy array of the shape (N,) where N is the number of data points. 3. 1am: The regularization coefficient À, which is a scalar positive value. See the objective function below. and returns the linear regression weight vector which is a numpy array with a shape of (d+1,1). Your function should: 1. Have an Intercept Weight: In other words, your fitting model should be minimizing the following mean-squared loss N VE Σ( - (B₁ + B₂x) + B₂x + + Bax)² + AB¹ B. N L(B; X, Y, A)² = i=1 An easy way to do this is by concatenating a constant 1-column to the data matrix (think about the right numpy function and the proper call given the defined loss and weight vector format). Hint: The textbook has provided you with the solution for the least squares optimization with ridge regression which could be helpful. 2. Never Raise An Error, and Return the Solution with the Smallest Euclidean Norm in case the optimal weight vector is not unique. For instance, when the number of data points is smaller than the dimension, many optimal weight vectors exist. Po Hint: Reviewing your linear algebra may be helpful in this case. You may want to use the Moore-Penrose matrix inversion. Note: The regularization coefficient will not be used for the first two problems. However, it would be used later, and we expect you to implement it correctly here. In : def linear regression (X, Y, lam=0): assert X.ndim==2 N = X.shape [0] d = X.shape [1] assert Y.size -- N Y_col Y.reshape (-1,1) #your code here assert beta.shape == (d+1, 1) return beta Write a function linear regression that fits a linear regression model, and takes the following two arguments as input: 1. x: A numpy array of the shape (N,d) where N is the number of data points, and d is the data dimension. Do not assume anything about N or d other than being a positive integer. 2. Y: A numpy array of the shape (N,) where N is the number of data points. 3. 1am: The regularization coefficient À, which is a scalar positive value. See the objective function below. and returns the linear regression weight vector which is a numpy array with a shape of (d+1,1). Your function should: 1. Have an Intercept Weight: In other words, your fitting model should be minimizing the following mean-squared loss N VE Σ( - (B₁ + B₂x) + B₂x + + Bax)² + AB¹ B. N L(B; X, Y, A)² = i=1 An easy way to do this is by concatenating a constant 1-column to the data matrix (think about the right numpy function and the proper call given the defined loss and weight vector format). Hint: The textbook has provided you with the solution for the least squares optimization with ridge regression which could be helpful. 2. Never Raise An Error, and Return the Solution with the Smallest Euclidean Norm in case the optimal weight vector is not unique. For instance, when the number of data points is smaller than the dimension, many optimal weight vectors exist. Po Hint: Reviewing your linear algebra may be helpful in this case. You may want to use the Moore-Penrose matrix inversion. Note: The regularization coefficient will not be used for the first two problems. However, it would be used later, and we expect you to implement it correctly here. In : def linear regression (X, Y, lam=0): assert X.ndim==2 N = X.shape [0] d = X.shape [1] assert Y.size -- N Y_col Y.reshape (-1,1) #your code here assert beta.shape == (d+1, 1) return beta

Answer rating: 100% (QA)

Answer Heres the implementation of the linearregression function import numpy as np def linearregres... View the full answer