Question: Recall the standard support vector machine formulation: minimize w^2_2 subject to yi(w xi w0) 1, i = 1, . . . , m, where m

Recall the standard support vector machine formulation: minimize w^2_2 subject to yi(w xi w0) 1, i = 1, . . . , m, where m is the number of points and n is the number of dimensions, is a quadratic program because the objective function is quadratic and the constraints are affine. A linear program on the other hand uses only affine objective function and constraints, and there are efficient polynomial-time algorithms for solving them. By replacing the 2- norm in the objective function with the 1-norm (x1 = Pn i=1 |xi |), we get minimize w_1 subject to yi(w xi w0) 1, i = 1, . . . , m. (3) Note that this is still not a linear program because the objective value contains absolute values, but we will convert this problem into an equivalent linear problem. (i) Suppose we know that the output y depends only on a few input variables (i.e. the optimal w is sparse). Would the 1-norm or 2-norm SVM make more sense? Justify your

Step by Step Solution

There are 3 Steps involved in it

1 Expert Approved Answer
Step: 1 Unlock blur-text-image
Question Has Been Solved by an Expert!

Get step-by-step solutions from verified subject matter experts

Step: 2 Unlock
Step: 3 Unlock

Students Have Also Explored These Related Mathematics Questions!