Question: 10. Solve this problem using the EM algorithm: A sample (21, 12, 23) is observed counts from a multinomial population with probabilities: (@-20,20, 20+;). The

 10. Solve this problem using the EM algorithm: A sample (21,
12, 23) is observed counts from a multinomial population with probabilities: (@-20,20,

10. Solve this problem using the EM algorithm: A sample (21, 12, 23) is observed counts from a multinomial population with probabilities: (@-20,20, 20+;). The objective is to obtain the maximum likelihood estimate of 0. The pdf of multinomial distribution for this sample is n! P(I; 0) = IT2!x3! *0 ) " ( 40 ) " ( 0 +! ) " In order to use EM algorithm, we put this into the framework of an incomplete data problem. Define (C1, 12, 21, 22) with multinomial distribution probabilities ( - ;0, 20, 20, ;), where 21 + 22 = 13, (21, 22) are missing data. Consider the estimation of 0 when (21, 12, 13) = (38, 34, 125), do the following: (a) Write down the complete data log-likelihood based on ($1, $2, 21, 22). (b) Describe the steps in the EM algorithm to compute the EM estimate of 0. For example, what are the E-step and M-step equations, and how to iterate the algorithm until it converges. Hint: e.g., conditioning on 21 + 22 = 23, 21 is distributed as Binomial(125, p = (0/4) /(1/2 + 0/4)). Note: Even if you have a closed-form solution, still do it using this algorithm]. (c) Write an R. program to realize the algorithm in Part (b). Include your R. code and report the result you obtain, i.e., what is your initial value in iteration, what is the estimate of 0, and to what decimal place that your algorithm stops

Step by Step Solution

There are 3 Steps involved in it

1 Expert Approved Answer
Step: 1 Unlock blur-text-image
Question Has Been Solved by an Expert!

Get step-by-step solutions from verified subject matter experts

Step: 2 Unlock
Step: 3 Unlock

Students Have Also Explored These Related Mathematics Questions!