Question: A classifier is being tested on two datasets: Dataset 1 , with 1 0 0 positives and 1 0 0 negatives, and Dataset 2 ,
A classifier is being tested on two datasets: Dataset with positives and negatives, and Dataset with positives and negatives. The confusion matrices of the classifier on the two datasets are provided below. Dataset Predicted Predicted Actual Actual Dataset Predicted Predicted Actual Actual a Calculate the Precision, Recall, TPR and FPR for the classifier on Dataset and Dataset b Based on your observations from these results, if you had to choose between the following two evaluation metric pairs: precision recall and TPR FPR which one would you choose in the following scenarios and why? Provide brief explanations in context with your observations from the results above. The evaluation is required to be invariant to changes in the relative numbers of positives and negatives in the evaluation dataset. c Compute the accuracy of the classifier on Dataset you can leave your answer in fractions Construct a trivial classifier that can achieve better accuracy on Dataset without even looking at the attributes of the data. What is the accuracy of this trivial classifier?
Step by Step Solution
There are 3 Steps involved in it
1 Expert Approved Answer
Step: 1 Unlock
Question Has Been Solved by an Expert!
Get step-by-step solutions from verified subject matter experts
Step: 2 Unlock
Step: 3 Unlock
