Because the extrinsic evaluations are realistic but expensive, you have learned an intrinsic evaluation metric, the...
Fantastic news! We've Found the answer you've been seeking!
Question:
Transcribed Image Text:
Because the extrinsic evaluations are realistic but expensive, you have learned an intrinsic evaluation metric, the perplexity PP(W) = (W)¹/", where n indicates the length of the test data W = w₁w2...wn by concatenating all sentences. You measured q(W) by a language model learned on a training data. In particular, you have two different but same amount of datasets D₁: whether reports and D₂: phone conversations. Two trigram models 9₁ and 92 are learned on D₁ and D2, respectively. Suppose you measure the perplexity of an unseen weather reports data with 9₁, and the perplexity of an unseen phone conversation data of the same length with q2. Explain which perplexity is likely higher than the other. Q3.2 5 Points Now you measure the perplexity of an unseen weather reports data with 92, and the perplexity of an unseen phone conversation data of the same length with q₁. If the perplexity measured with 91 is lower, can you conclude that q₁ is a better model than 92? Yes O No Q3.3 5 Points When you are evaluating the perplexity as stated above, what will happen if the test data consists of some unseen words that you have never observed in the training data? (select all correct) If use smoothing method, p(unseen word)>0 If use smoothing method, p(unseen word)=0 If use smoothing method, we can compute perplexity If use smoothing method, we can not compute perplexity Because the extrinsic evaluations are realistic but expensive, you have learned an intrinsic evaluation metric, the perplexity PP(W) = (W)¹/", where n indicates the length of the test data W = w₁w2...wn by concatenating all sentences. You measured q(W) by a language model learned on a training data. In particular, you have two different but same amount of datasets D₁: whether reports and D₂: phone conversations. Two trigram models 9₁ and 92 are learned on D₁ and D2, respectively. Suppose you measure the perplexity of an unseen weather reports data with 9₁, and the perplexity of an unseen phone conversation data of the same length with q2. Explain which perplexity is likely higher than the other. Q3.2 5 Points Now you measure the perplexity of an unseen weather reports data with 92, and the perplexity of an unseen phone conversation data of the same length with q₁. If the perplexity measured with 91 is lower, can you conclude that q₁ is a better model than 92? Yes O No Q3.3 5 Points When you are evaluating the perplexity as stated above, what will happen if the test data consists of some unseen words that you have never observed in the training data? (select all correct) If use smoothing method, p(unseen word)>0 If use smoothing method, p(unseen word)=0 If use smoothing method, we can compute perplexity If use smoothing method, we can not compute perplexity
Expert Answer:
Answer rating: 100% (QA)
1 Suppose you measure the perplexity of an unseen weather report data with q and the perplexity of an unseen phone conversation data of the same lengt... View the full answer
Related Book For
Practical Management Science
ISBN: 978-1305250901
5th edition
Authors: Wayne L. Winston, Christian Albright
Posted Date:
Students also viewed these programming questions
-
Write a VBA subroutine to compute the average molecular weight of a gas mixture (MW average) with the following composition by mass (mass of component/total mass). Recall: MWaverage = where yi is the...
-
Planning is one of the most important management functions in any business. A front office managers first step in planning should involve determine the departments goals. Planning also includes...
-
Read the case study "Southwest Airlines," found in Part 2 of your textbook. Review the "Guide to Case Analysis" found on pp. CA1 - CA11 of your textbook. (This guide follows the last case in the...
-
Infinity & Beyond, Inc. is a producer of high-tech fashion merchandise. The company's marketing department has identified a new product concept through discussions with potential customers conducted...
-
A drum of 200-mm radius is attached to a disk of radius rA = 150 mm. The disk and drum have a combined mass of 5 kg and a combined radius of gyration of 120 mm and are suspended by two cords. Knowing...
-
Evaluate a pricing decision of your company based on psychological pricing. Was price set optimally? If not, why not? How would you adjust price? Compute the profit consequences of the change.
-
Use the following steps to show that \(r\) is bounded by -1 and 1 (These steps are due to Koch, 1990). a. Let \(a\) and \(c\) be generic constants. Verify \[\begin{aligned}0 & \leq \frac{1}{n-1}...
-
1. Battery is unpermitted, unprivileged, intentional contact with anothers person. In a physician-patient relationship, how does a physician receive consent to touch the body of a patient? 2. Could...
-
A standardization battle is underway in the market for electric cars, with BMW, Nissan, Tesla and Toyota investing to establish their technology as the dominant standard. In the battle, Tesla has...
-
CI Individual C owns all of the shares of Cee Ltd, a Canadian-controlled private corporation holding investments in marketable securities. Individual D owns all of the shares of Dee Ltd., a...
-
Luke's Lubricants starts business on January 1. The following operations data are available for January for the one lubricant it produces. Beginning inventory started in January Ending...
-
Calculate annual depreciation for the first two years using each of the following methods. Round all amounts to the nearest dollar. 1. Straight-line. 2. Double-declining-balance. 3. Activity-based....
-
In keeping with its long-term share repurchase plan, 2,000 shares were retired on July 1. Dow's net income for the year ended December 31, 2011, was $2,100,000. The income tax rate is 40%. As part of...
-
What is the preferable presentation of accounts receivable from officers, employees, or affiliated companies on a balance sheet??
-
Smith Companys break-even point is 12,200 units. Each unit generates variable costs of $2.20 and is sold for $4.90. What are the total fixed costs?
-
Compute the companys current ratio and debt ratio at December 31, 2012. At December 31, 2011, the current ratio was 1.81 and the debt ratio was 0.34. Did the companys ability to pay debts improve or...
-
Exercise 10.1.8: Recursive Minimum Write a recursive function that finds the minimum value in anArrayList. Your function signature should be public static int findMinimum(ArrayList ) One way to think...
-
2.) Find the Laplace transform of f(t) 7e-St cos 2t +9 sinh2 2t. Use Laplace Table. %3D
-
Suppose you buy an electronic device that you operate continuously. The device costs you $300 and carries a one-year warranty. The warranty states that if the device fails during its first year of...
-
You have $5 and your opponent has $10. You flip a fair coin and if heads comes up, your opponent pays you $1. If tails comes up, you pay your opponent $1. The game is finished when one player has all...
-
In the United Copiers service center model, we assumed that a customer is serviced totally by a single service center. Suppose a customer can be serviced partly by multiple service centers. For...
-
What circumstances might lead you to write-off a debt as bad and not close the debtor's account?
-
A business had always made an allowance for doubtful debts at the rate of 3 per cent of accounts receivable. On 1 January 2015 the amount for this, brought forward from the previous year, was 400....
-
A business started trading on 1 January 2014. During the two years ended 31 December 2014 and 2015 the following debts were written off to the Bad Debts Account on the dates stated: On 31 December...
Study smarter with the SolutionInn App