Consider the following data set for a binary class problem. (a) Calculate the information gain when splitting

Question:

Consider the following data set for a binary class problem.
Consider the following data set for a binary class problem.
(a)

(a) Calculate the information gain when splitting on A and B. Which attribute would the decision tree induction algorithm choose?
(b) Calculate the gain in the Gini index when splitting on A and B. Which attribute would the decision tree induction algorithm choose?
(c) Figure 4.13 shows that entropy and the Gini index are both monotonously increasing on the range [0, 0.5] and they are both monotonously decreasing on the range [0.5, 1]. Is it possible that information gain and the gain in the Gini index favor different attributes? Explain.

Fantastic news! We've Found the answer you've been seeking!

Step by Step Answer:

Related Book For  book-img-for-question

Introduction to Data Mining

ISBN: 978-0321321367

1st edition

Authors: Pang Ning Tan, Michael Steinbach, Vipin Kumar

Question Posted: