Fleur-de-Lis is a boutique bakery specializing in cupcakes. The bakers at Fleur-de-Lis like to experiment with different combinations of four major ingredients in its cupcakes and collect customer feedback; it has data on 150 combinations of ingredients with the corresponding customer reception for each combination classified as “thumbs up” (Class 1) or “thumbs down” (Class 0). To better anticipate customer feedback on new recipes, Fleur-de-Lis has determined that a k-nearest neighbors classifier with k = 10 seems to perform well.

Using a cutoff value of 0.5 and a validation set of 45 observations, Fleur-de-Lis constructs the following confusion matrix and the ROC curve for the k-nearest neighbors classifier with k = 10:

 As the confusion matrix shows, there is one observation that actually received thumbs down, but the k-nearest neighbors classifier predicts a thumbs up. Also, there is one observation that actually received a thumbs up, but the k-nearest neighbors classifier predicts a thumbs down. Specifically:

 

A) Explain how the probability of Thumbs Up was computed for Observation A and Observation B. Why was Observation A classified as Thumbs Up and Observation B classified as Thumbs Down?

B) Compute the values of sensitivity and specificity corresponding to the confusion matrix created using the cutoff value of 0.5. Locate the point corresponding to these values of sensitivity and specificity on the ROC curve shown above (If required, round your answers to three decimal places. Do not round intermediate calculations)

Sensitivity=

Specificity=

Choose the correct graph below:

 

 

C) Based on what we know about Observation B, if the cutoff value is lowered to 0.2, what happens to the values of sensitivity and specificity? Use the ROC curve to estimate the values of sensitivity and specificity for a cutoff value of 0.2. (If required, round your answers to three decimal places. Do not round intermediate calculations)

Sensitivity=

Specificity=

Choose the correct graph below:

 

   

Transcribed Image Text:

Actual Feedback Thumbs Up Thumbs Down Sensitivity 1.0 0.9- 0.8- 0.7 0.6 0.5 0.4 0.3 T 0.2- 0.1 Predicted Feedback Thumbs Up 13 1 0.0 0.0 0.1 0.2 0.3 0.4 0.5 0.6 1-specificity Thumbs Down 1 30 Random Classifier Optimum Classifier Fitted Classifier 0.7 0.8 0.9 1.0 Actual Feedback Thumbs Up Thumbs Down Sensitivity 1.0 0.9- 0.8- 0.7 0.6 0.5 0.4 0.3 T 0.2- 0.1 Predicted Feedback Thumbs Up 13 1 0.0 0.0 0.1 0.2 0.3 0.4 0.5 0.6 1-specificity Thumbs Down 1 30 Random Classifier Optimum Classifier Fitted Classifier 0.7 0.8 0.9 1.0

Answer rating: 100% (QA)

A The probability of Thumbs Up for each observation is computed based on the fraction of knearest ne... View the full answer