Question: Consider the following data set for a binary class problem. (a) Calculate the information gain when splitting on A and B. Which attribute would the

Consider the following data set for a binary class problem.

(a) Calculate the information gain when splitting on A and B. Which attribute would the decision tree induction algorithm choose?
(b) Calculate the gain in the Gini index when splitting on A and B. Which attribute would the decision tree induction algorithm choose?
(c) Figure 4.13 shows that entropy and the Gini index are both monotonously increasing on the range [0, 0.5] and they are both monotonously decreasing on the range [0.5, 1]. Is it possible that information gain and the gain in the Gini index favor different attributes? Explain.

BF T T F T F F F T F

Step by Step Solution

★★★★★

3.42 Rating (177 Votes )

There are 3 Steps involved in it

1 Expert Approved Answer

Step: 1 Unlock

a The contingency tables after splitting on attributes A and B are The overall ... View full answer

Question Has Been Solved by an Expert!

Get step-by-step solutions from verified subject matter experts

Step: 2 Unlock

Step: 3 Unlock

Document Format (1 attachment)

908-M-S-D-A (8611).docx

120 KBs Word File

Students Have Also Explored These Related Statistics Questions!

Consider the following data set: 38 55 76 20 30 66 17 54 a. Determine the 20th percentile. b. Determine the 40th percentile. c. Determine the 60th percentile.

Consider the following data set: a. Construct a frequency distribution using classes of 3 up to 5, 5 up to 7, etc. b. Construct relative frequency, cumulative frequency, and cumulative relative...

Consider the following data set: a. Construct a frequency distribution using classes of 210 up to 0, 0 up to 10, etc. How many of the observations are at least 10 but less than 20? b. Construct a...

Consider the following data set for a binary class problem. (a) Calculate the information gain when splitting on A and B. Which attribute would the decision tree induction algorithm choose? (b)...

A B CLASS LABEL T F + T T + T T + T F - T T + F F - F F - F F - T T - T F - Given the following data set for a binary class problem A) Calculate the information gain when splitting on A and B B) What...

Consider the following data set for a binary class problem. Calculate the information gain when splitting on attribute A and B, respectively. Which attribute would the decision tree induction...

Consider the following data set for a binary class problem. NOTE: Solve any calculation required using Python. (a) Calculate the information gain when splitting on A and B. Which attribute would the...

Consider the following data set for a binary class problem. Calculate the information gain when splitting on attribute A and B, respectively. Which attribute would the decision tree induction...

Consider the following data set for a binary class problem. Calculate the information gain when splitting on attribute A and B. respectively. Which attribute would the decision tree induction...

You are traveling in Europe The first country you visit is Switzerland You have planned to spend a week there So you convert USD 5000 into Swiss Franks SFR at the quote of USD SFR 11710 12110 at the...

Unilever sells products such as Ben & Jerry's and Breyer's ice cream, Hellman's mayonnaise, and Lipton tea. The company published a report showing comparisons of sustainability indicators for 2008...

As of 2 0 2 2 , approximately _ _ _ _ _ _ _ _ _ _ blank of mutual fund assets were invested in bond funds. Multiple Choice 4 7 % 2 3 % 3 2 % 3 7 %

23. Oakland passengers 2013 The scatterplot below shows the number of passengers at Oakland (CA) airport month by month since 1997. (www.oaklandairport.com) a) Describe the patterns in passengers at...

For Exercises 1214, use the data set churn. Normalize the numerical data, recode the categorical variables, and deal with the correlated variables. Generate a neural network model for classifying...

Describe the benefits and drawbacks of using large or small values for the momentum term.

Describe the benefits and drawbacks of using large or small values for the learning rate.

Tema A customer is exporting 25 boxes of porcelain coffee cups. Each box contains 20 cups. The cost of pre- carriage is CAD $100.00. The cost of each cup is CAD $5.00. The terms of trade are FCA...

Refer to the Froth Slope microbrewery example at the beginning of this chapter how does the $ 500,000 piece of the terminal value relate to the future value of the $ 100.000? That is the brewpub...

Compute the incremental net income of the investment for each year. (Do not round intermediate calculations.) Compute the incremental cash flows of the investment for each year. (Do not round...