Question: Multi-task regression (by Andrew Ng) Thus far, we only considered regression with scalar-valued responses. In some applications, the response is itself a vector: yi R

Multi-task regression (by Andrew Ng) Thus far, we only considered regression with scalar-valued responses. In some applications, the response is itself a vector: yi R p . We posit the relationship between the features and the vector-valued response is linear: y T i x T i B , where B R dp is a matrix of regression coefficients. (a) Express the sum of squared residuals (SSR) in matrix notation (i.e. without using any summations). Hint: work out how to express the SSR in terms of X = x T 1 . . . x T n R nd , Y = y T 1 . . . y T n R np . (b) Find the matrix of regression coefficients that minimizes the SSR. (c) Instead of minimizing the SSR, we break up the problem into p regression problems with scalar-valued responses. That is, we fit p linear models of the form (yi)k x T i k, where k R d . How do the regression coefficients from the p separate regressions compare to the matrix of regression coefficients that minimizes the SSR.

Step by Step Solution

There are 3 Steps involved in it

1 Expert Approved Answer
Step: 1 Unlock blur-text-image
Question Has Been Solved by an Expert!

Get step-by-step solutions from verified subject matter experts

Step: 2 Unlock
Step: 3 Unlock

Students Have Also Explored These Related Mathematics Questions!