Question: Problem 1 : Bigrams ( 3 pts ) ( a ) Compute the bigram count table, C ( w 2 | w 1 ) for
Problem : Bigrams ptsa Compute the bigram count table, Cww for the sentence "I saw Susie sitting in a shoe shine shop. Where Susie sits Susie shines, and where Susie shines Susie sits." Put w in the left hand column, and w in the top row. Include punctuation, clitics, and sentence start and end markers as individual tokens, and index words using their lemmatized forms. ptb Compute the bigram probability table, Pww for above sentence, assuming the following overall unigram counts: CI Csee CSusie Csit Cin Ca Cshoe Cshine Cshop CWhere C Cand Assume there are sentences in the corpus, and they all end with a period. ptc Compute the probability and perplexity of the first sentence in a using the bigram approximation. pt
Step by Step Solution
There are 3 Steps involved in it
1 Expert Approved Answer
Step: 1 Unlock
Question Has Been Solved by an Expert!
Get step-by-step solutions from verified subject matter experts
Step: 2 Unlock
Step: 3 Unlock
