Question: Implement the logistic regression algorithm using Gradient Descent in analogy with neural networks (as described in the lectures, Chapter 4, or [1], Sections 11.3{11.5) for
Implement the logistic regression algorithm using Gradient Descent in analogy with neural networks (as described in the lectures, Chapter 4, or [1], Sections 11.3{11.5) for p attributes. The objective function, which your program should minimize, can be either the training MSE MSE := 1 n Xn i=1 (yi p(xi))2 (1) (cf. \Brier loss" on slide 99 in Chapter 4) or the negative log-likelihood (NLL) NLL := X i:yi=1 log p(xi) X i:yi=0 log(1 p(xi)) (as described on slide 44 of Chapter 4); the choice is yours. (Be careful not to confuse p as the number of attributes and p(x) as the predicted probability of 1.) Your program can be written either in R or in MAT- LAB. You are not allowed to use any existing implementations of logistic regression or Gradient Descent in R, MATLAB, or any other language, and should code logistic regression from rst principles. However, you are allowed to set the number of attributes p to a specic value that allows you to do the following tasks.
Step by Step Solution
There are 3 Steps involved in it
Get step-by-step solutions from verified subject matter experts
