Question: Suppose that a decision tree is trained on 1 0 0 0 training examples, and achieves 9 0 % accuracy on the training examples. What

Suppose that a decision tree is trained on 1000 training examples, and achieves 90%
accuracy on the training examples. What is the smallest and largest accuracy that this decision tree
can possibly achieve on a test set of 1000 examples? Justify your answer. You can assume there are
only two classes.
1b (20 points). Suppose that a decision tree is trained on 1000 training examples, and achieves
80% accuracy on the training examples. What is the smallest and largest possible value for the
entropy at a leaf node of this decision tree? Remember that entropy is measured on the training set.
You can assume there are only two classes.
1c (20 points). Suppose that a decision tree is trained on 1000 training examples, and achieves
100% accuracy on the training examples. What is the smallest and largest possible value for the
entropy at a leaf node of this decision tree? Again, remember that entropy is measured on the
training set. You can assume there are only two classes.

Step by Step Solution

There are 3 Steps involved in it

1 Expert Approved Answer
Step: 1 Unlock blur-text-image
Question Has Been Solved by an Expert!

Get step-by-step solutions from verified subject matter experts

Step: 2 Unlock
Step: 3 Unlock

Students Have Also Explored These Related Programming Questions!