Question: We will be working with the following data set for Problems 1 and 2 . There are two trinary features x 1 and x 2

We will be working with the following data set for Problems 1 and 2. There are two trinary features
x1 and x2, and a class variable y with values 0 and 1.
Problem 1: Nave Bayes (20 points)
The maximum likelihood class CPT is Pr(Y)=(0.5,0.5). Estimate the feature CPTs
Pr(x1|Y) and Pr(x2|Y) without Laplace smoothing.
Which value(s) of x1 give a direct prediction of y regardless of the value of x2, and what are
the predictions of y for each? Give the same analysis for values of x2. Are there any feature
combinations (x1,x2) for which a prediction is not well defined?
Suppose that we find out that the class values y in the data set may not be correct. We can
use the estimated probabilities in Part 1 as a starting point for expectation-maximization.
Compute the expected counts Pr(Y|x1,x2) for each sample (x1,x2) in the data set.
Perform the maximization step and find the new CPTs Pr(Y),Pr(x1|Y), and Pr(x2|Y).
We will be working with the following data set

Step by Step Solution

There are 3 Steps involved in it

1 Expert Approved Answer
Step: 1 Unlock blur-text-image
Question Has Been Solved by an Expert!

Get step-by-step solutions from verified subject matter experts

Step: 2 Unlock
Step: 3 Unlock

Students Have Also Explored These Related Programming Questions!