Question: Consider a model with a single predictor X1, no intercept term and an outcome y. We fit a lasso regression and obtain a coefficient for

Consider a model with a single predictor X1, no intercept term and an outcome y. We fit a lasso regression and obtain a coefficient for the predictor X1.

Now we create a new predictor X2 = X1 (you can imagine copying the column X1) and train another lasso model using the same regularization parameter as before. We will call the coefficients of the new model 1 and 2 (remember, there is no intercept term).

Compare the two models. It may be useful to consider the following points:

(1) can the models make the same predictions?;

(2) are there unique optimal coefficients 1,2?;

(3) are 1,2 related to ?

Step by Step Solution

There are 3 Steps involved in it

1 Expert Approved Answer
Step: 1 Unlock blur-text-image
Question Has Been Solved by an Expert!

Get step-by-step solutions from verified subject matter experts

Step: 2 Unlock
Step: 3 Unlock

Students Have Also Explored These Related Mathematics Questions!