Question: ( a ) Compute the bigram count table, C ( w 2 | w 1 ) for the sentence I saw Susie sitting in a
a Compute the bigram count table, Cww for the sentence "I saw Susie sitting in a shoe shine shop. Where Susie sits Susie shines, and where Susie shines Susie sits." Put w in the left hand column, and w in the top row. Include punctuation, clitics, and sentence start and end markers as individual tokens, and index words using their lemmatized forms. pt
b Compute the bigram probability table, Pww for above sentence, assuming the following overall unigram counts: CI Csee CSusie Csit Cin Ca Cshoe Cshine Cshop CWhere C Cand Assume there are sentences in the corpus, and they all end with a period. pt
c Compute the probability and perplexity of the first sentence in a using the bigram approximation. pt
Step by Step Solution
There are 3 Steps involved in it
1 Expert Approved Answer
Step: 1 Unlock
Question Has Been Solved by an Expert!
Get step-by-step solutions from verified subject matter experts
Step: 2 Unlock
Step: 3 Unlock
