Question: Problem 4 ( 1 5 points ) Consider the AdaBoost algorithm we discussed in the class ? 1 . AdaBoost is an example of ensemble

Problem 4(15 points) Consider the AdaBoost algorithm we discussed in the class ?1. AdaBoost is an example of ensemble classifiers where the weights in next round are decided based on the training error of the weak classifier learned on the current weighted training set. We wish to run the AdaBoost on the dataset provided in Table 1.
\table[[Instance,Color,Size,Shape,Edible?],[D1,Yellow,Small,Round,Yes],[D2,Yellow,Small,Round,No],[D3,Green,Small,Irregular,Yes],[D4,Green,Large,Irregular,No],[D5,Yellow,Large,Round,Yes],[D6,Yellow,Small,Round,Yes],[D7,Yellow,Small,Round,Yes],[D8,Yellow,Small,Round,Yes],[D9,Green,Small,Round,No],[D10,Yellow,Large,Round,No],[D11,Yellow,Large,Round,Yes],[D12,Yellow,Large,Round,No],[D13,Yellow,Large,Round,No],[D14,Yellow,Large,Round,No],[D15,Yellow,Small,Irregular,Yes],[D16,Yellow,Large,Irregular,Yes]]
Table 1: Mushroom data with 16 instances, three categorical features, and binary labels.
a) Assume we choose the following decision stump f1(a shallow tree with a single decision node), as the first predictor (i.e., when training instances are weighted uniformly):What would be the weight of f_(1) in final ensemble classifier (i.e., alpha_(1) in {:f(x)=sum_(i=1)^(K)alpha_(i)f_(i)(x))?b) After computing f_(1), we proceed to next round of AdaBoost. We begin by recomputing data weights depending on the error of f_(1) and whether a point was (mis)classified by f_(1). What is the weight of each instance in second boosting iteration, i.e., after the points have been re-weighted? Please note that the weights across the training set are to be uniformly initialized.c) In AdaBoost, would you stop the iteration if the error rate of the current weak classifier on the weighted training data is 0?
Problem 4 ( 1 5 points ) Consider the AdaBoost

Step by Step Solution

There are 3 Steps involved in it

1 Expert Approved Answer
Step: 1 Unlock blur-text-image
Question Has Been Solved by an Expert!

Get step-by-step solutions from verified subject matter experts

Step: 2 Unlock
Step: 3 Unlock

Students Have Also Explored These Related Accounting Questions!