Question: Consider the process of building a decision - tree based classifier using Entropy as a measure of impurity associated with a tree node that represents

Consider the process of building a decision-tree based classifier using Entropy as a measure of impurity associated with a tree node that represents a subset of training examples. A node is split into
partitions represented by its child nodes based on the values of a selected attribute. The goodness of the attribute for the split, referred to as gain of the attribute, is estimated in terms of the difference
between the impurity of the parent node and the weighted sum of the impurities of the child nodes.
Consider the training set of examples described in terms of three attributes A1,A2 and A3 in addition to the distribution of examples among four classes namely C1,C2,C3 and C4.
Each row of the table describes a subset of examples in terms of the three binary attributes A1,A2 and A3 and indicates the number of examples among the subset that fall into class C1,C2,C3 and C4
in terms of the values given in the last four columns. The classifier aims at classifying the training examples into one among the predefined set of classes.
Estimate the goodness of the attributes for splitting the training set given in the table. Which of the following is TRUE about the goodness of attributes for a split.
a. Splitting based on attribute A2 is the better way to partition the training set.
b. The value of the information gain of attribute A2 is greater than 0.5 and less than 0.6.
c. The value of the gain ratio of attribute A2 is greater than 0.2.
d. The value of the information gain of attribute A1 is greater than 0.5 and less than 0.7.
Consider the process of building a decision -

Step by Step Solution

There are 3 Steps involved in it

1 Expert Approved Answer
Step: 1 Unlock blur-text-image
Question Has Been Solved by an Expert!

Get step-by-step solutions from verified subject matter experts

Step: 2 Unlock
Step: 3 Unlock

Students Have Also Explored These Related Programming Questions!