Question: Question 1 . ( 2 0 pts . ) Given a training set with m examples, the standard form of the regularized loss function for

Question 1.(20 pts.) Given a training set with m examples, the standard form of the
regularized loss function for linear regression is
J()=12m[i=1m(h(x(i))-y(i))2+j=1nj2]
Also, consider the following loss function which is in canonical form
J'()=(Y-x)T(Y-x)+T
where features are represented as a matrix x(each row is an example and each
column is an individual feature) and true target values are represented as a column
vector Y.
(a) Are the two functions J() and J'() exactly equivalent? Explain briefly.
(b) Suppose we accidentally write J'()=(Y-x)T(Y-x)+YTY instead.
Explain briefly what happens with this form of "regularization".
(c) Suppose we use the correct expression but accidentally choose 0. Explain
briefly how this defeats the purpose of regularization.
 Question 1.(20 pts.) Given a training set with m examples, the

Step by Step Solution

There are 3 Steps involved in it

1 Expert Approved Answer
Step: 1 Unlock blur-text-image
Question Has Been Solved by an Expert!

Get step-by-step solutions from verified subject matter experts

Step: 2 Unlock
Step: 3 Unlock

Students Have Also Explored These Related Databases Questions!