In this problem we use techniques from matrix algebra to calculate the least squares regression line...
Fantastic news! We've Found the answer you've been seeking!
Question:
Transcribed Image Text:
In this problem we use techniques from matrix algebra to calculate the least squares regression line described way back in Chapter 2 (please see pp. 89-91 and class notes). We explore this in a relatively simple case, since the method becomes increasingly time-consuming to calculate by hand the more data points there are. You are then asked to implement the method in several different situations. Given data points (1.1). (22,92). (23.33), we wish to find the real numbers a and b which make y = ar + b the equation of the (unique) least squares regression line for the given points. Let's temporarily assume that all three of the points are collinear (i.e., all lie on a single line). Then the system I1 Ho would have as solution the coefficients of whatever line contained all three of our points. However, if no single line contains all three points, then the above linear system cannot have a solution (in the language of linear systems, it would be "overdetermined", with too many different equations to be satisfied for any one point to satisfy them all). If our "temporary assumption" is not correct, and no single line contains all three points, how can we calculate the least squares regression line?! 21 22 23 1 11 In fact, we do so by adjusting the linear system above in a specific way that will result in a linear system that has a solution. By a technical mathematical argument (that would not be suitable for us here) the solution of the revised system will be the coefficients of theactual least squares regression line. The "adjustment" is to multiply both the left and right-hand sides of the original matrix equation above by a matrix [2 1 1 1 77 Note how this new matrix is related is related to the original coefficient matrix: the first row of the new matrix is the first column of the old one, and the second row of the new matrix is the second column of the old one (in matrix algebra, we say that the new matrix is the transpose of the old one). After this multiplication, our system is given by 1800-6 x²+x²²+x²²x₁ + x₂ + x3 3 2₁+2₂ +23 9/1 9/2 9/3 **][8] - [* This is a system that we can solve by our methods from Chapter 6. Carrying out the matrix multiplications, we get the revised system in a more manageable form (remembering, of course, that the expressions involving all the 's and y's will be single numbers): 12 +22+32 1+2+3 a 1+2+3 ³][8] 3 b which, after the arithmetic is performed, gives us 14 6 a 6 3 11 = To see this once in action, let's calculate the linear regression line for the points (1.1), (2,2) and (3,2). This means x₁=1, ₂2, 233. 311, 32= 2, and y3 = 2. The revised linear system then becomes [ 1 2 Y *+ 2 3 9/1 $][8]-[8] b 11+122 +239/3 91 +92 +93 1.1+2·2+3-2 1+2+2 Applying our Chapter 6 row-reduction methods to this system results in the unique solution (a,b) = (1/2,2/3). This means that the least squares linear regression line is Now it's your turn. (a) Use the above method to calculate the least squares regression line for the data (1,4), (2,6). (4,8). (b) Explore the case where the three data points do in fact lie on a single line by calculating the least squares regression line for the data (2,3), (4.5), (6, 7). Does our method find the line on which the points lie? (c) This method actually works for any number of data points. For n points, where we have 1,2,3, extend this by adding 24 through, and do the same with the y's. Note that even though the dimensions of the matrices that go into the system are larger (2 x n and nx 2), the final system is still 2 x 21 So the systems get more time consuming to set up. but involve about the same number of steps to solve. Try to expand your horizons by using our method to calculate the least squares regression line for the data points (1,4), (2,3), (3,5) and (4.8). In this problem we use techniques from matrix algebra to calculate the least squares regression line described way back in Chapter 2 (please see pp. 89-91 and class notes). We explore this in a relatively simple case, since the method becomes increasingly time-consuming to calculate by hand the more data points there are. You are then asked to implement the method in several different situations. Given data points (1.1). (22,92). (23.33), we wish to find the real numbers a and b which make y = ar + b the equation of the (unique) least squares regression line for the given points. Let's temporarily assume that all three of the points are collinear (i.e., all lie on a single line). Then the system I1 Ho would have as solution the coefficients of whatever line contained all three of our points. However, if no single line contains all three points, then the above linear system cannot have a solution (in the language of linear systems, it would be "overdetermined", with too many different equations to be satisfied for any one point to satisfy them all). If our "temporary assumption" is not correct, and no single line contains all three points, how can we calculate the least squares regression line?! 21 22 23 1 11 In fact, we do so by adjusting the linear system above in a specific way that will result in a linear system that has a solution. By a technical mathematical argument (that would not be suitable for us here) the solution of the revised system will be the coefficients of theactual least squares regression line. The "adjustment" is to multiply both the left and right-hand sides of the original matrix equation above by a matrix [2 1 1 1 77 Note how this new matrix is related is related to the original coefficient matrix: the first row of the new matrix is the first column of the old one, and the second row of the new matrix is the second column of the old one (in matrix algebra, we say that the new matrix is the transpose of the old one). After this multiplication, our system is given by 1800-6 x²+x²²+x²²x₁ + x₂ + x3 3 2₁+2₂ +23 9/1 9/2 9/3 **][8] - [* This is a system that we can solve by our methods from Chapter 6. Carrying out the matrix multiplications, we get the revised system in a more manageable form (remembering, of course, that the expressions involving all the 's and y's will be single numbers): 12 +22+32 1+2+3 a 1+2+3 ³][8] 3 b which, after the arithmetic is performed, gives us 14 6 a 6 3 11 = To see this once in action, let's calculate the linear regression line for the points (1.1), (2,2) and (3,2). This means x₁=1, ₂2, 233. 311, 32= 2, and y3 = 2. The revised linear system then becomes [ 1 2 Y *+ 2 3 9/1 $][8]-[8] b 11+122 +239/3 91 +92 +93 1.1+2·2+3-2 1+2+2 Applying our Chapter 6 row-reduction methods to this system results in the unique solution (a,b) = (1/2,2/3). This means that the least squares linear regression line is Now it's your turn. (a) Use the above method to calculate the least squares regression line for the data (1,4), (2,6). (4,8). (b) Explore the case where the three data points do in fact lie on a single line by calculating the least squares regression line for the data (2,3), (4.5), (6, 7). Does our method find the line on which the points lie? (c) This method actually works for any number of data points. For n points, where we have 1,2,3, extend this by adding 24 through, and do the same with the y's. Note that even though the dimensions of the matrices that go into the system are larger (2 x n and nx 2), the final system is still 2 x 21 So the systems get more time consuming to set up. but involve about the same number of steps to solve. Try to expand your horizons by using our method to calculate the least squares regression line for the data points (1,4), (2,3), (3,5) and (4.8).
Expert Answer:
Related Book For
Probability and Statistical Inference
ISBN: 978-0321923271
9th edition
Authors: Robert V. Hogg, Elliot Tanis, Dale Zimmerman
Posted Date:
Students also viewed these accounting questions
-
Calculate the least squares regression line, Price = b0 + b1(Mileage). Report the regression model, the R2 value, the correlation coefficient, the t-statistics, and p-values for the estimated model...
-
The least squares regression equation y = 0.7676x - 52.6841 relates the carbon dioxide emissions (in hundred thousands of tons), y, and energy produced (hundred thousands of megawatts), x, for all...
-
In this problem we investigate whether either UDP or TCP provides a degree of end-point authentication. a. Consider a server that receives a request within a UDP packet and responds to that request...
-
Describe a setting (either real or fictitious) that you have been in where either your emotions or the emotions of someone else had more impact on what was being communicated than it should have had....
-
How does the Internet enable entrepreneurs to create global businesses at start up? Has this always been the case? During his regular evening reading time, Bill McNeely came across several articles...
-
The circuit shows a battery connected to a switch and three identical lamps, L 1 , L 2 and L 3 . a. Copy the diagram and add: i. An arrow to show the conventional current direction in the circuit...
-
Suppose that you make an investment that will cost $\$ 1,000$ and will pay you interest of $\$ 100$ per year for the next 20 years. Then at the end of the 20 years, the investment will pay $\$...
-
Which type of unemployment would be affected with the following changes? Would it go up or down? a. Increased employment benefits b. Heavy snowfall in Minnesota c. Online job search becomes more...
-
What insights can be gleaned from complexity theory and systems thinking in understanding the emergent dynamics of protracted conflicts, and how might such insights inform the design of multifaceted,...
-
How might you combine social entrepreneurship with traditional options for going global?
-
Create a Console application in which you input numbers 1 to 10 from the user and save them in an array, and then print the odd numbers and even numbers in the form of a table. e.g ODD EVEN 1 2 3 4 5...
-
Evaluate the function \(f(x, y)=\frac{2}{3} e^{-x / 2} \cos (y-1)\) for \(x=-0.23, y=2.7\) by: a. Using the subs command. b. Conversion into a MATLAB function.
-
Ben deposits $5,000 now into an account that earns 7.5 percent interest compounded annually. He then deposits $1,000 per year at the end of the first and second years. How much will the account...
-
Which securities must be registered under the 1933 Act? Explain.
-
Amy was denied employment in a certain company because she was not married. One of the companys rules states that only married female employees are eligible for employment. There are murmurs that...
-
Explain how corporations provide limited liability to their owners.
-
On July 1, 2020, Dandy corporation. sold a machine to a customer in exchange for a three-year, zero-interest-bearing note with a face amount of $926,100. The cost of the machine is $600,000 and the...
-
A routine activity such as pumping gasoline can be related to many of the concepts studied in this text. Suppose that premium unleaded costs $3.75 per gal. Work Exercises in order. Use the...
-
Let X1, X2, ... , Xn be a random sample from an exponential distribution with mean θ. Show that the likelihood ratio test of H0: θ = θ0 against H1:...
-
The state of Michigan generates a three-digit number at random twice a day, seven days a week for its Daily 3 game. The numbers are generated one digit at a time. Consider the following set of 50...
-
An insurance company sells both homeowners insurance and automobile deductible insurance. Let X be the deductible on the homeowners insurance and Y the deductible on automobile insurance. Among those...
-
Approximately 50,000 new titles, including new editions, are published each year in the United States, giving rise to a $25 billion industry in 2001. In terms of percentage of sales, this industry...
-
When you think of political persuasion, you may think of the effortsthat political campaigns undertake to persuade you that their candidate is betterthan the other candidate. In truth, campaigns are...
-
In late 2013, the taxi company Yourcabs.com in Bangalore, India, was facing a problem with the drivers using their platformnot all drivers were showing up for their scheduled calls. Drivers would...
Study smarter with the SolutionInn App