Question: Bigrams (a) Compute the bigram count table, C(w2|w1) for the sentence I think you can do it. If you think you can do it, you
Bigrams (a) Compute the bigram count table, C(w2|w1) for the sentence I think you can do it. If you think you can do it, you can do it. Put w1 in the left hand column, and w2 in the top row. Include punctuation, clitics, and sentence start and end markers and individual tokens. (b) Compute the bigram probability table, P(w2|w1), for the following sentence, assuming the following overall unigram counts: I think you can do it. C(I) = 50, C(think) = 80, C(you) = 25, C(can) = 40, C(do) = 70, C(it) = 60. Assume there are 50 sentences in the corpus, and they all end with a period. (c) Compute the probability and perplexity of the sentence in (a) using the bigram approximation.
Step by Step Solution
There are 3 Steps involved in it
Get step-by-step solutions from verified subject matter experts
