You have 20 teams that have signed up for the competition and your boss requires you...

Transcribed Image Text:

You have 20 teams that have signed up for the competition and your boss requires you to provide a confidence interval of 0.05 on the prediction ac- curacy of the best classifier that will hold with probability at least 95%. In other words, with probability at least 95% the expected zero-one er- ror of the classifier you have selected should not exceed your estimate by more than 0.05 (one-sided error). [Side remark: the confidence interval of 0.05 means that the error will not increase by more than 5% of the total number of predictions.] How many samples do you have to keep aside in order to satisfy this requirement, assuming that you accept 1 solution from each team? Provide a complete calculation, numerical answers without any derivations or explanations will not be accepted. You have 20 teams that have signed up for the competition and your boss requires you to provide a confidence interval of 0.05 on the prediction ac- curacy of the best classifier that will hold with probability at least 95%. In other words, with probability at least 95% the expected zero-one er- ror of the classifier you have selected should not exceed your estimate by more than 0.05 (one-sided error). [Side remark: the confidence interval of 0.05 means that the error will not increase by more than 5% of the total number of predictions.] How many samples do you have to keep aside in order to satisfy this requirement, assuming that you accept 1 solution from each team? Provide a complete calculation, numerical answers without any derivations or explanations will not be accepted.