Question: I don't know how to solve the following problem, The assignment is due tonight. Can someone help me get started? Problem 4: Smoothing and Probability

I don't know how to solve the following problem, The assignment is due tonight. Can someone help me get started?

I don't know how to solve the following problem, The assignment is

Problem 4: Smoothing and Probability Distributions In the absalute discounting model of smoothing, all non-zero counts are discounted by a constant amount (5 Where 0 0 Pa1,5(wn|w1 . . . wn_1) = (VNo)5 _ W otherwise 0 Here C(w1 . . .wn) is the number of times an . . . wn has been seen, Pm is the absolute dis- counting estimate, V is the size of the vocabulary, N is the total number of times the context wl . . . wn_1 has been seen, and No is the number of word types that were unseen in this con- text. Under the linedrdircaunting model, the estimated count of seen words is discounted by a certain fraction, dened by a constant a Where 0 0 Show that both absolute discounting and linear discounting yield probability distributions for any context wl . . .wnil. In other words, show that either denition denes a probability measure over possible next words 11),, that sums to

Step by Step Solution

There are 3 Steps involved in it

1 Expert Approved Answer
Step: 1 Unlock blur-text-image
Question Has Been Solved by an Expert!

Get step-by-step solutions from verified subject matter experts

Step: 2 Unlock
Step: 3 Unlock

Students Have Also Explored These Related Mathematics Questions!