Question: Suppose we have two predictive models, M_1 and M_2 and run 10 rounds of 10-fold cross-validation test using the two models. In each round, a

 Suppose we have two predictive models, M_1 and M_2 and run

Suppose we have two predictive models, M_1 and M_2 and run 10 rounds of 10-fold cross-validation test using the two models. In each round, a training set and a testing set are determined based on the 10-fold cross-validation method, and the same training set (respectively testing set) is used to build (respectively to test) the two models. The error rates obtained from the test are given in the following table. Perform a t-test at a significance level of 0.001 to determine if one model is significantly better than the other. A t-distribution table is provided as an attachment to this assignment. Suppose we have two predictive models, M_1 and M_2 and run 10 rounds of 10-fold cross-validation test using the two models. In each round, a training set and a testing set are determined based on the 10-fold cross-validation method, and the same training set (respectively testing set) is used to build (respectively to test) the two models. The error rates obtained from the test are given in the following table. Perform a t-test at a significance level of 0.001 to determine if one model is significantly better than the other. A t-distribution table is provided as an attachment to this assignment

Step by Step Solution

There are 3 Steps involved in it

1 Expert Approved Answer
Step: 1 Unlock blur-text-image
Question Has Been Solved by an Expert!

Get step-by-step solutions from verified subject matter experts

Step: 2 Unlock
Step: 3 Unlock

Students Have Also Explored These Related Databases Questions!