Master Yoda is concerned about the number of Jedi apprentices that have turned to the Dark...

 

Transcribed Image Text:

Master Yoda is concerned about the number of Jedi apprentices that have turned to the Dark Side, so he's decided to train a decision tree on some historical data to help identify problem cases in the future. The following table summarizes whether or not each of 12 initiates turned to the Dark Side based on their age when their Jedi training began, whether or not they completed their training, their general disposition, and their species. Dark Side Age Started Training Completed Training 0 5 0 9 0 6 0 0 0 0 1 1 1 1 1 6 7 8 5 9 8 8 6 7 (a) What is the initial entropy of Dark Side? 1 1 0 1 0 1 1 0 0 0 0 0 Disposition Happy Happy Happy Sad Sad Angry Angry Happy Sad Sad Species Human Gungan Wookiee Mon Calamari Human Human Ewok Ewok Human Human Wookiee Angry Angry Mon Calamari (b) Which attribute would the decision-tree building algorithm choose to use for the root of the tree? (c) What is the information gain of the attribute you chose to split on in the previous question? Master Yoda is concerned about the number of Jedi apprentices that have turned to the Dark Side, so he's decided to train a decision tree on some historical data to help identify problem cases in the future. The following table summarizes whether or not each of 12 initiates turned to the Dark Side based on their age when their Jedi training began, whether or not they completed their training, their general disposition, and their species. Dark Side Age Started Training Completed Training 0 5 0 9 0 6 0 0 0 0 1 1 1 1 1 6 7 8 5 9 8 8 6 7 (a) What is the initial entropy of Dark Side? 1 1 0 1 0 1 1 0 0 0 0 0 Disposition Happy Happy Happy Sad Sad Angry Angry Happy Sad Sad Species Human Gungan Wookiee Mon Calamari Human Human Ewok Ewok Human Human Wookiee Angry Angry Mon Calamari (b) Which attribute would the decision-tree building algorithm choose to use for the root of the tree? (c) What is the information gain of the attribute you chose to split on in the previous question?