Question: After trying many multiple linear regression analyses based on the model M1 in Problem 1 above, a data analyst obtained the following statistics. The regression

After trying many multiple linear regression analyses based on the model M1 in Problem 1 above, a data analyst obtained the following statistics.

The regression sum of squares SS(B0) by excluding the two regressors x1, x2 .

The regression sums of squares SS(B0), SS(B0, B1), by excluding the regressor x2.

The regression sums of squares SS(B0), SS(B0, B2), by excluding the regressor x1.

The regression sums of squares SS(B0), SS(B0, B1, B2); that is, include all the regressors.

a) The data analyst used statistical tests derived from sums of squares to determine whether x1 or x2 should be excluded to come up with the final regression model. That is, the final model may be a subset model of M1.

1) Discuss with mathematical proof whether the ordinary least-squares estimator(s) for the remaining regressor(s) in the final model is biased.

2) Discuss with mathematical proof whether the ordinary least-squares estimator(s) for the remaining regressor(s) in the final model has a smaller variance than the respective ordinary least-squares estimator(s) in fitting the model M1.

3) The analyst also explored addition of another regressor x3; that is, Model M1 could be extended to include x3. Discuss with mathematical proof whether the ordinary least-squares estimator for B1, say, based on the extended model is biased for B1 if the true model is M1.

After trying many multiple linear regression analyses based on the model M1

In a multiple linear regression analysis, {yo-151i: xzijJ = 1, ..., n , are statistically independent and satisfy the model (M1) given by: y=o+31x1+zx2+EJ where the response variable y is continuous, the regressor vector X = (x1, x2)r has mean vector (,uxl, rum)! and positive definite variance-covariance matrix EX , the random errors a: conditional on X:- are statistically independent and normally distributed with mean zero and variance 02 which does not depend on X. After trying many multiple linear regression analyses based on the model M1 a data analyst obtained the following statistics. The regression sum of squares 55(30) by excluding the two regressors x1, x2 . The regression sums of squares 55(50),55(, 51), by excluding the regressor x2 . The regression sums of squares 55(30),SS(ED, g), by excluding the regressor x1 . The regression sums of squares 55(30),SS(ED, 31,32); that is, include all the regressors. The data analyst used statistical tests derived from sums of squares to determine whether x1 or x2 should be excluded to come up with the final regression model. That is, the final model may be a subset model of M1. 1} Discuss with mathematical proof whether the ordinary least-squares estimator(s) for the remaining regressor{s) in the final model is biased. 2} Discuss with mathematical proof whether the ordinary least-squares estimator(s) for the remaining regressor{s) in the final model has a smaller variance than the respective ordinary least-squares estimator{s} in fitting the model M1. 3} The analyst also explored addition of another regressor x3; that is, Model M1 could be extended to include x3. Discuss with mathematical proof whether the ordinary least- squares estimator for ,81, say, based on the extended model is biased for ,81 if the true model is M1

Step by Step Solution

There are 3 Steps involved in it

1 Expert Approved Answer
Step: 1 Unlock blur-text-image
Question Has Been Solved by an Expert!

Get step-by-step solutions from verified subject matter experts

Step: 2 Unlock
Step: 3 Unlock

Students Have Also Explored These Related Mathematics Questions!