Question: 2: Robust Regression, PSGD and Mirror Descent Consider the problem of robust regression, where some small number of measurements have been potentially completely corrupted. One
2: Robust Regression, PSGD and Mirror Descent Consider the problem of robust regression, where some small number of measurements have been potentially completely corrupted. One way to formulate an optimization problem to solve this robust regression is as follows: min?:s.t.:???1?. The rationale for this formulation stems from the idea that because of the 1 -error, huge errors are not disproportionally penalized, as they would be in the squared error formulation (this is the formulation we have worked with before, including in the previous problem), and therefore the optimal solution is less sensitive to outliers. You will solve this problem using Projected Subgradient Descent, and also Mirror Descent. Let the constraint set be the simplex
Step by Step Solution
There are 3 Steps involved in it
Get step-by-step solutions from verified subject matter experts
