Question: could you help me on this problem ? Thank you . In this exercise, we solve a simple optimization problem related to the multinomial naive

could you help me on this problem ? Thank you .

could you help me on this problem ? Thank you . In

In this exercise, we solve a simple optimization problem related to the multinomial naive Bayes classifier. Fix a finite set % = (x1,...,XM} and real numbers c1, . .., CM 2 0. Consider the following optimiza tion problem W = argmax L(w) := _ clog wi (1) W=[WI....>WM]TERM 1= 1 subject to: wis a PMF on . We will show that the solution is given by C1 CM W = , . . (2) E Ci (i)) The constraint set of (1) is the 'simplex' 6 = (we RM|0 S w1, . .., WM S 1, EM, w; = 1). Denote the larger constraint set 6 = (we RM | EM, wi = 1). Let A ER be a Lagrange multiplier for 6. Then the Lagrangian is M g (1, w) = L(w) -_ _ wi -1. (3) Show that 1 needs to satisfy ag(1, w) C1 CM - A [1,. .., 1] = 0. (4) Ow W1 WM Conclude that (2) is the global maximum L(w) over 6. (ii) From (i), conclude that (2) is the global maximum L(w) over 6

Step by Step Solution

There are 3 Steps involved in it

1 Expert Approved Answer
Step: 1 Unlock blur-text-image
Question Has Been Solved by an Expert!

Get step-by-step solutions from verified subject matter experts

Step: 2 Unlock
Step: 3 Unlock

Students Have Also Explored These Related Mathematics Questions!