Question: Suppose we have two predictive models, M_1 and M_2 and run 10 rounds of 10-fold cross-validation test using the two models. In each round, a
Suppose we have two predictive models, M_1 and M_2 and run 10 rounds of 10-fold cross-validation test using the two models. In each round, a training set and a testing set are determined based on the 10-fold cross-validation method, and the same training set (respectively testing set) is used to build (respectively to test) the two models. The error rates obtained from the test are given in the following table. Perform a t-test at a significance level of 0.001 to determine if one model is significantly better than the other. A t-distribution table is provided as an attachment to this assignment. Suppose we have two predictive models, M_1 and M_2 and run 10 rounds of 10-fold cross-validation test using the two models. In each round, a training set and a testing set are determined based on the 10-fold cross-validation method, and the same training set (respectively testing set) is used to build (respectively to test) the two models. The error rates obtained from the test are given in the following table. Perform a t-test at a significance level of 0.001 to determine if one model is significantly better than the other. A t-distribution table is provided as an attachment to this assignment
Step by Step Solution
There are 3 Steps involved in it
Get step-by-step solutions from verified subject matter experts
