Question: I am running negative binomial regression on SPSS - 2 9 . When i use model performance metrics ( AIC , Deviance and Log Likelihood

I am running negative binomial regression on SPSS-29. When i use model performance metrics (AIC, Deviance and Log Likelihood) i realize that they are similar (e.g.9.0 and 8.8 for example) for main (train) dataset with about 200 events and the dataset used for external validation (test), which also had 200 events. However, when i did 5-fold cross validation, the AIC, Deviance and Log Likelihood for each fold made up of 40 events is half (e.g.4.4 and 4.8 for example) of main dataset and external validation dataset both with 200 events.
Questions (main data is for training and external validation data is for testing):
(1) is this overfitting although sample sizes differ?

Step by Step Solution

There are 3 Steps involved in it

1 Expert Approved Answer
Step: 1 Unlock blur-text-image
Question Has Been Solved by an Expert!

Get step-by-step solutions from verified subject matter experts

Step: 2 Unlock
Step: 3 Unlock

Students Have Also Explored These Related Programming Questions!