4. [Decision Trees] (6 pts) In class, we covered how to learn binary decision trees. In...
Fantastic news! We've Found the answer you've been seeking!
Question:
Transcribed Image Text:
4. [Decision Trees] (6 pts) In class, we covered how to learn binary decision trees. In this question, you will modify the decision tree learning algorithm to obtain ternary decision trees (i.e, each internal node has three children). Assume all features are real-valued, and the labels are categorical (i.e., classification). 2 a. (2 pts) Each internal node should split a single feature into three intervals x; ≥ t1, t₁ > x; ≥ t2, and t₂ > xj. Write down all parameters for this split. b. (2 pts) Write down the information gain for a single split. You do not have to expand the entropy (e.g., for traditional decision trees, the information gain is IG(j, t) = H (Z) - H(Z[x; ≥ t])P(x; ≥ t) - H(Z[x; <t])P(x; <t)). c. (2 pts) Does this strategy increase, decrease, or keep unchanged the model capac- ity compared to traditional decision trees? What if the depth of the decision tree is bounded by 3? 4. [Decision Trees] (6 pts) In class, we covered how to learn binary decision trees. In this question, you will modify the decision tree learning algorithm to obtain ternary decision trees (i.e, each internal node has three children). Assume all features are real-valued, and the labels are categorical (i.e., classification). 2 a. (2 pts) Each internal node should split a single feature into three intervals x; ≥ t1, t₁ > x; ≥ t2, and t₂ > xj. Write down all parameters for this split. b. (2 pts) Write down the information gain for a single split. You do not have to expand the entropy (e.g., for traditional decision trees, the information gain is IG(j, t) = H (Z) - H(Z[x; ≥ t])P(x; ≥ t) - H(Z[x; <t])P(x; <t)). c. (2 pts) Does this strategy increase, decrease, or keep unchanged the model capac- ity compared to traditional decision trees? What if the depth of the decision tree is bounded by 3?
Expert Answer:
Answer rating: 100% (QA)
a For a ternary decision tree split at an internal node for a feature xj the thre... View the full answer
Related Book For
Artificial Intelligence A Modern Approach
ISBN: 9780134610993
4th Edition
Authors: Stuart Russell, Peter Norvig
Posted Date:
Students also viewed these programming questions
-
Taco Bell took a major hit when it was reported that the meat they used was filled with bi - products and fillers. Do you think that they have redeemed their reputation by having fresh ingredients...
-
I need a report with a specific product from a company Assessment 3: Individual Assignment Marking Criteria Report: Structure and Marking Criteria Executive Summary (5 marks) A well written...
-
Planning is one of the most important management functions in any business. A front office managers first step in planning should involve determine the departments goals. Planning also includes...
-
Cost-Volume-Profit (CVP) analysis can be used to determine the effect of changes in costs and volumes on a company's net profits. This project assignment assumes that you are newly hired as an...
-
Calculation the rest mass of a proton in MeV/c2
-
Firms A and B are Cournot competitors who produce good Qi, where i = A,B. Assume both firms have a fixed cost of 50 and a variable cost of 5Q2. Let demand for good q by Q = 240 - 2P, where P is...
-
Define patterns, methodologies, and recipes and give an example for each.
-
Three methods of interperiod income tax allocation have been advocated. These include (1) the asset/liability method, (2) the deferred method, and (3) the net-of-tax method. Required Define...
-
Elon Musk decided to take over Twitter. Twitter has 50 million stocks outstanding with a current price of $40 per share. On 1/07/2022 Musk offered $48 per share conditioned on buying at least 50% of...
-
For each of the following four networks, discuss the consequences if a connection fails. a. Five devices arranged in a mesh topology b. Five devices arranged in a star topology (not counting the hub)...
-
Discuss the various entities involved in inventing the internet and how the internet evolved over time. Explain the difference between acoustics and psychoacoustics. Why is the difference important?
-
Modeling the motion of the fly on the web as a mass on a spring, at what frequency will the web vibrate when the fly hits it? A. \(0.91 \mathrm{~Hz}\) B. \(2.9 \mathrm{~Hz}\) C. \(9.1 \mathrm{~Hz}\)...
-
Harbor seals, like many animals, determine the direction from which a sound is coming by sensing the difference in arrival times at their two ears. A small difference in arrival times means that the...
-
A \(20 \mathrm{~kg}\) block of aluminum sits on the bottom of a tank of water. How much force does the block exert on the bottom of the tank? Long-distance balloon flights are usually made using a...
-
Group the count responses on UTIs and catheter blockages in the data set "intake" into three levels: no occurrence, only once, and more than once. Use these three-level outcomes to assess (a) whether...
-
A medical ultrasound imaging system sends out a steady B10 stream of very short pulses. To simplify analysis, the reflection of one pulse should be received before the next is transmitted. If the...
-
1. Software deteriorates rather than wears out because: () a. Software suffers from exposure to hostile environments. b. Defects are more likely to arise after software has been used often. c....
-
Trade credit from suppliers is a very costly source of funds when discounts are lost. Explain why many firms rely on this source of funds to finance their temporary working capital.
-
True or False: In expectiminimax search with two players, one max and the other chance, one can use pruning to reduce the search cost.
-
In this chapter we present Bayesian networks, originally called belief networks, for the representation of uncertainty but other types of graphical models may also be used. Consider, Markov networks,...
-
We are running Gibbs sampling in the Bayes net shown in Figure S13.47 for the query P(B, C | + h, +i, +j). The current state is +a, +b, +c, +d, +e, +f, +g, +h, +i, +j, +k. Write out an expression for...
-
Calculate: (a) \(f=a /(b c)\), where \(a=2.34\mathrm{~mm}^{2}, b=54.26\mathrm{~m}\), and \(c=0.14\mu \mathrm{m}\); (b) \(g=k t^{3}\), where \(k=1.208\times 10^{-2}\mathrm{~s}^{-3}\) and...
-
Which of these is a hierarchical approach of subordination of individuals that work together and contribute to serve a common goal? Formal organization Informal structures Functional structure ...
-
A sound organization Prevents corruption Enhances creativity None of the above All of the above
Personnel/human Resource Management A Diagnostic Approach 5th Edition - ISBN: 0256059632 - Free Book
Study smarter with the SolutionInn App