Question: Suppose we train a trigram language model with add-one smoothing on a given corpus. The corpus contains V word types. Express a formula for esti-

Suppose we train a trigram language model with add-one smoothing on a given corpus. The corpus contains V word types. Express a formula for esti- mating P(w3|w1,w2), where w3 is a word which follows the bigram (wl,w2), in terms of various N-gram counts and V. Use the notation c(wl,w2,w3) to denote the number of times that trigram (wl,w2,w3) occurs in the corpus, and so on for bigrams and unigrams
Step by Step Solution
There are 3 Steps involved in it
Get step-by-step solutions from verified subject matter experts
