Question: Consider the softmargin support vector machine: I 1 2 71. 31325 HVH|| +7251 s.t. i((vH,ii)c) Z 151- fort: 1,...7n 51-20, fori:1,...,n (a) For increasing 7,

Consider the softmargin support vector machine: I 1 2 71. 31325 HVH|| +7251 s.t. i((vH,ii)c) Z 151- fort: 1,...7n 51-20, fori:1,...,n (a) For increasing 7, will the margin increase or decrease, and why? Hint: You may check the picture on Page 61 of Lecture 3. (b) For increasing '7, will the resulting \"VH H increase or decrease, and why? (c) Consider the following training data in R2 (where it- = {5:}, 5:12)). For a large but nite value of 7, what will be the empirical risk (with 0 1 loss)? (Note: do not try to run an SVM by hand. You should draw the data and argue the answer in a few sentences.) 5311 0.0 1.0 1.0 0.5 0.5 5.0 5.0 6.0 5.5 5.5 5.5 it? 0.0 1.0 1.0 0.5 0.5 1.0 1.0 0.0 0.5 0.5 0.0 331- +1 +1 +1 +1 +1 1 1 1 1 1 +1 Hint: Note that when 7 is large but nite, we want 2:;151- (and hence the number of data points that are on the wrong side of the margin) to be as small as possible. When the previous condition is satised, we also want the margin to be large. What would be the afne hyperplane tted by the softmargin support vector machine base on this intuition? (d) Consider the data in part (c) For a large but nite value of 7, what are the support vectors
Step by Step Solution
There are 3 Steps involved in it
Get step-by-step solutions from verified subject matter experts
