Question: TASK 1 ( 6 0 points ) 1 a ( 2 0 points ) Suppose that a decision tree is trained on 1 0 0

TASK 1(60 points)1a (20 points) Suppose that a decision tree is trained on 1000 training examples, and achieves 90% accuracy on the training examples. What is the smallest and largest accuracy that this decision tree can possibly achieve on a test set of 1000 examples? Justify your answer. You can assume there are only two classes.1b (20 points). Suppose that a decision tree is trained on 1000 training examples, and achieves 80% accuracy on the training examples. What is the smallest and largest possible value for the entropy at a leaf node of this decision tree? Remember that entropy is measured on the training set. You can assume there are only two classes.1c (20 points). Suppose that a decision tree is trained on 1000 training examples, and achieves 100% accuracy on the training examples. What is the smallest and largest possible value for the entropy at a leaf node of this decision tree? Again, remember that entropy is measured on the training set. You can assume there are only two classes.

Step by Step Solution

There are 3 Steps involved in it

1 Expert Approved Answer
Step: 1 Unlock blur-text-image
Question Has Been Solved by an Expert!

Get step-by-step solutions from verified subject matter experts

Step: 2 Unlock
Step: 3 Unlock

Students Have Also Explored These Related Programming Questions!