Question: Consider the process of building a decision - tree based classifier using Entropy as a measure of impurity associated with a tree node that represents
Consider the process of building a decisiontree based classifier using Entropy as a measure of impurity associated with a tree node that represents a subset of training examples. A node is split into
partitions represented by its child nodes based on the values of a selected attribute. The goodness of the attribute for the split, referred to as gain of the attribute, is estimated in terms of the difference
between the impurity of the parent node and the weighted sum of the impurities of the child nodes.
Consider the training set of examples described in terms of three attributes and in addition to the distribution of examples among four classes namely and
Each row of the table describes a subset of examples in terms of the three binary attributes and and indicates the number of examples among the subset that fall into class and
in terms of the values given in the last four columns. The classifier aims at classifying the training examples into one among the predefined set of classes.
Estimate the goodness of the attributes for splitting the training set given in the table. Which of the following is TRUE about the goodness of attributes for a split.
a Splitting based on attribute is the better way to partition the training set.
b The value of the information gain of attribute is greater than and less than
c The value of the gain ratio of attribute is greater than
d The value of the information gain of attribute is greater than and less than
Step by Step Solution
There are 3 Steps involved in it
1 Expert Approved Answer
Step: 1 Unlock
Question Has Been Solved by an Expert!
Get step-by-step solutions from verified subject matter experts
Step: 2 Unlock
Step: 3 Unlock
