Question: Bigrams (a) Compute the bigram count table, C(w2|w1) for the sentence I think you can do it. If you think you can do it, you

Bigrams (a) Compute the bigram count table, C(w2|w1) for the sentence I think you can do it. If you think you can do it, you can do it. Put w1 in the left hand column, and w2 in the top row. Include punctuation, clitics, and sentence start and end markers and individual tokens. (b) Compute the bigram probability table, P(w2|w1), for the following sentence, assuming the following overall unigram counts: I think you can do it. C(I) = 50, C(think) = 80, C(you) = 25, C(can) = 40, C(do) = 70, C(it) = 60. Assume there are 50 sentences in the corpus, and they all end with a period. (c) Compute the probability and perplexity of the sentence in (a) using the bigram approximation.

Step by Step Solution

There are 3 Steps involved in it

1 Expert Approved Answer
Step: 1 Unlock blur-text-image
Question Has Been Solved by an Expert!

Get step-by-step solutions from verified subject matter experts

Step: 2 Unlock
Step: 3 Unlock

Students Have Also Explored These Related Databases Questions!