Question: I don't know how to solve the following problem, The assignment is due tonight. Can someone help me get started? Problem 4: Smoothing and Probability
I don't know how to solve the following problem, The assignment is due tonight. Can someone help me get started?

Problem 4: Smoothing and Probability Distributions In the absalute discounting model of smoothing, all non-zero counts are discounted by a constant amount (5 Where 0 0 Pa1,5(wn|w1 . . . wn_1) = (VNo)5 _ W otherwise 0 Here C(w1 . . .wn) is the number of times an . . . wn has been seen, Pm is the absolute dis- counting estimate, V is the size of the vocabulary, N is the total number of times the context wl . . . wn_1 has been seen, and No is the number of word types that were unseen in this con- text. Under the linedrdircaunting model, the estimated count of seen words is discounted by a certain fraction, dened by a constant a Where 0 0 Show that both absolute discounting and linear discounting yield probability distributions for any context wl . . .wnil. In other words, show that either denition denes a probability measure over possible next words 11),, that sums to
Step by Step Solution
There are 3 Steps involved in it
Get step-by-step solutions from verified subject matter experts
