Question: 6. (15 pts) In logistic regression, the response variable is sometimes labeled y (-1,+1) rather than y {0, 1). Using a maximum likelihood approach,

6. (15 pts) In logistic regression, the response variable is sometimes labeled y  (-1, +1} rather than y  (0,

6. (15 pts) In logistic regression, the response variable is sometimes labeled y (-1,+1) rather than y {0, 1). Using a maximum likelihood approach, show that when y (-1, +1}, the logistic regression problem is to m min log (1+ exp(-yax)) (3) where x is the vector of parameters to be estimated (i.e. the regression coefficients) and a, is the vector of predictor variables for observation i (i=1,...,m). Here are the steps. (a) Show that 1 1+exp(-yaa) P(Y=y)= is in fact a valid probability distribution when y {-1, +1}. Here, the subscript i is dropped. (b) Write the log-likelihood function. (e) Show that minimizing the negative of the log-likelihood function leads to the problem (4) shown above.

Step by Step Solution

3.40 Rating (150 Votes )

There are 3 Steps involved in it

1 Expert Approved Answer
Step: 1 Unlock

a To show that PY 1 1 expyat is a valid probability distribution when y 1 1 we need to verify two properties nonnegativity and a sum of probabilities ... View full answer

blur-text-image
Question Has Been Solved by an Expert!

Get step-by-step solutions from verified subject matter experts

Step: 2 Unlock
Step: 3 Unlock

Students Have Also Explored These Related Programming Questions!