Question: Consider the training examples shown in Table 4.2 for a binary classification problem. (a) What is the entropy of this collection of training examples with

Consider the training examples shown in Table 4.2 for a binary classification problem.
(a) What is the entropy of this collection of training examples with respect to the positive class?
(b) What are the information gains of a1 and a2 relative to these training examples?
(c) For a3, which is a continuous attribute, compute the information gain for every possible split.
(d) What is the best split (among a1, a2, and a3) according to the information gain?
(e) What is the best split (between a1 and a2) according to the classification error rate?
(f) What is the best split (between a1 and a2) according to the Gini index?

Step by Step Solution

★★★★★

3.32 Rating (170 Votes )

There are 3 Steps involved in it

1 Expert Approved Answer

Step: 1 Unlock

a There are four positive examples and five negative examples Thus P 49 and P 59 The entropy of th... View full answer

Question Has Been Solved by an Expert!

Get step-by-step solutions from verified subject matter experts

Step: 2 Unlock

Step: 3 Unlock

Document Format (1 attachment)

908-M-S-D-A (8609).docx

120 KBs Word File

Students Have Also Explored These Related Statistics Questions!

Consider the training examples shown in Table 4.1 for a binary classification problem. a) Compute the Gini index for the overall collection of training examples. (b) Compute the Gini index for the...

Consider the following set of training examples. (a) Compute a two-level decision tree using the greedy approach described in this chapter. Use the classification error rate as the criterion for...

Consider a binary classification problem with the following set of attributes and attribute values: ¢ Air Conditioner = {Working, Broken} ¢ Engine = {Good, Bad} ¢ Mileage = {High,...

Consider the training examples shown in Table 4.8 for a binary classification problem. (a) What is the entropy of this collection of training examples with respect to the positive class (b) What are...

2 0 6 Chapter 3 Classification Table 3 . 6 . Data set for Exercise 4 . \ table [ [ Instance , a 1 , a 2 , a 3 , Target Class ] , [ 1 , T , T , 1 . 0 , + ] , [ 2 , T , T , 6 . 0 , + ] , [ 3 , T , F ,...

Consider the training examples shown in Table 3.6 for a binary classification problem. Gini index = What is the entropy of this collection of training examples with respect to the class attribute?...

let me know if any questions. Need help asap. Consider the training examples shown in Table 1 for a binary classification problem. Customer ID Gender Car TypeClass 1 M Family 00 2 M Sports 3 M Sports...

I need help with this soon! How could I calculate this by hand? Compute information gain for a3 for each potential split point and report the best split point for a3. 1. [2596] Consider the training...

Can you please help me answer this problem! This could be answered using python code or just hand written solutions are okay! 1. [2596] Consider the training examples shown in Table 1 for a binary...

#1 show your work. If you write code to implement this, show your calculations and compare it with the code solution. 1 (40) Consider the training examples shown in Table 1 for a binary...

You are required to work in this task individually. any suspicious activities or cheating will result in zero grade in this task. 1. what are the basic levels of research? 2. what do you mean by...

Which of the following statements is most correct? a. The ability of firms to engage in socially beneficial projects that involve voluntary costs is constrained by competition. b. The actions that...

Lucas has separate individual investment accounts consisting of unique securities tailored to provide capital for his children's education fund and for purchasing a vacation home. Both have seven -...

25. Unusual points Each of these four scatterplots shows a cluster of points and one stray point. For each, answer these questions: a) In what way is the point unusual? Does it have high leverage, a...

Set your neural network build options as follows: Use a Multilayer Perceptron and customize number of units in Hidden Layer 1 to be 1 and Hidden Layer 2 to be 0. For Stopping Rules, select ONLY...

For Exercises 1517, use the ClassifyRisk data set. Make sure the target variable takes the flag type. Compare the sign of (weight for Age-to-Neuron1) + (weight for Bias-to-Neuron1) * (weight for...

For Exercises 1517, use the ClassifyRisk data set. Consider the following quantity: (weight for Age-to-Neuron1) + (weight for Bias-to-Neuron1) * (weight for Neuron 1-to-Output node). Explain whether...

The malicious software that used to launch distributed denial of service ( DDoS ) attacks: Select one: a . logic bombs b . Trojan Horse c . Zombie d . b + c

Arnold Inc. is considering a proposal to manufacture high-end protein bars used as food supplements by body builders. The project requires use of an existing warehouse, which the firm acquired three...

If you paid $44 to a loan company for the use of $1, 233 for 88 days, what annual rate of interest did they charge? (Assume a 360-day year.) The annual rate of interest is %. (Round to three decimal...