Question: Let x denote an n d matrix where rows are training points, y denotes an n 1 vector of corresponding output value, w denotes a
Let denote an matrix where rows are training points, denotes an vector of corresponding output value, denotes a parameter vector and denotes the optimal parameter vector. To make the analysis easier we will consider the special case where the training data is whitened ieI For lasso regression, the optimal parameter vector is given by
where a Assume that wi what is the value of wi in this case?b Assume that wi what is the value of wi in this case c From a and b what is the condition for wi to be How can you interpret that condition?d Now consider ridge regression where the regularization term is replaced by lambda w What is the condition for wi How does it differ from the condition you obtained in c
Step by Step Solution
There are 3 Steps involved in it
1 Expert Approved Answer
Step: 1 Unlock
Question Has Been Solved by an Expert!
Get step-by-step solutions from verified subject matter experts
Step: 2 Unlock
Step: 3 Unlock
