Question: Problem 4 ( AdaBoosting ) ( 1 % ) Consider training an Adaboosting classifier using decision stumps on the data set illustrated in Figure 1
Problem AdaBoosting
Consider training an Adaboosting classifier using decision stumps on the data set illustrated in Figure :
Figure : AdaBoost Data set
a Which examples will have their weights increased at the end of the first iteration? Circle them.
b How many iterations will it take to achieve zero training error? Justify your answers and show each iteration step.
Suppose AdaBoost is run on training examples, and suppose on each round that the weighted training error of the th weak hypothesis is at most for some number After how many iterations, will the combined hypothesis be consistent with the training examples, ie achieves zero training error? Your answer should only be expressed in terms of and Hint: Recall that exponential loss is an upper bound for loss. What is the training error when example is misclassified?
Step by Step Solution
There are 3 Steps involved in it
1 Expert Approved Answer
Step: 1 Unlock
Question Has Been Solved by an Expert!
Get step-by-step solutions from verified subject matter experts
Step: 2 Unlock
Step: 3 Unlock
