Evaluation Metrics: Calculate the precision, recall, F1-score, and accuracy of the following text classifier that aims Confusion
Question:
Evaluation Metrics: Calculate the precision, recall, F1-score, and accuracy of the following text classifier that aims Confusion matrix to identify junk mail. Compare its predictions against the gold standard and evaluate its performance.
## Here are the inputted strings and the predictions: Gold-Standard ## String A: I am a lost prince and I need your help. - Junk Junk (TP) ## String B: This is Stacey. I have secret. Please pay reply. - Junk Junk (TP) ## String C: Your previous library card has expired. - Real Real (TN) ## String D: Congratulations! You are today's 2nd winner! - Real Junk (FP) ## String E: Hi Steve, here's my latest holiday snaps. - Junk Real (FN) ## String F: We may need to reschedule your appointment. - Real Real (TN) ## String G: Could you help me with question 5? - Junk Real (FN) ## String H: HELP! rEPLY ToDAy! Urgent! - Junk Junk (TP) ## String I: Attached is the requested information - Real Real (TN) ## String J: Great! I shall meet you then. - Real Real (TN)
### TP = 3 ### FP = 1 ### TN = 4 ### FN = 2
Is this correct?