Question: 12.5 L2-regularization. Let w be the solution of Maxent with a norm-2 squared regularization. (a) Prove the following inequality: kwk2 2r (Hint: you
12.5 L2-regularization. Let w be the solution of Maxent with a norm-2 squared regularization.
(a) Prove the following inequality: kwk2 2r (Hint: you could compare the values of the objective function at w and 0.). Generalize this result to other k kpp -regularizations with p > 1.
(b) Use the previous question to derive an explicit learning guarantee for Maxent with norm-2 squared regularization (Hint: you could use the last inequality given in Section 12.9 and derive an explicit expression for 2).
Step by Step Solution
There are 3 Steps involved in it
Get step-by-step solutions from verified subject matter experts
