Question: Consider the following methods for evaluating the performance of a learning algorithm in a particular setting. Method 1 . 2 0 examples are drawn at

Consider the following methods for evaluating the performance of a learning algorithm in a particular setting.
Method 1.20 examples are drawn at random. The method of 5-fold cross validation is applied, giving the
error estimate e1.
Method 2.16 examples are drawn at random. The classifier is trained using these examples. Another set
of 1000 examples are drawn at random, and the classifier is tested on these examples giving the error
estimate e2.
Method 3.1000 examples are drawn at random. The method of 5-fold cross validation is applied, giving
the error estimate e3.
What is the likely relation between the error estimates? Mark all answers that you believe will hold with
probability greater than 0.5.

Step by Step Solution

There are 3 Steps involved in it

1 Expert Approved Answer
Step: 1 Unlock blur-text-image
Question Has Been Solved by an Expert!

Get step-by-step solutions from verified subject matter experts

Step: 2 Unlock
Step: 3 Unlock

Students Have Also Explored These Related Programming Questions!